1
|
Nikravangolsefid N, Reddy S, Truong HH, Charkviani M, Ninan J, Prokop LJ, Suppadungsuk S, Singh W, Kashani KB, Garces JPD. Machine learning for predicting mortality in adult critically ill patients with Sepsis: A systematic review. J Crit Care 2024; 84:154889. [PMID: 39059094 DOI: 10.1016/j.jcrc.2024.154889] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2024] [Revised: 07/10/2024] [Accepted: 07/18/2024] [Indexed: 07/28/2024]
Abstract
INTRODUCTION Various Machine Learning (ML) models have been used to predict sepsis-associated mortality. We conducted a systematic review to evaluate the methodologies employed in studies to predict mortality among patients with sepsis. METHODS Following a pre-established protocol registered at the International Prospective Register of Systematic Reviews, we performed a comprehensive search of databases from inception to February 2024. We included peer-reviewed articles reporting predicting mortality in critically ill adult patients with sepsis. RESULTS Among the 1822 articles, 31 were included, involving 1,477,200 adult patients with sepsis. Nineteen studies had a high risk of bias. Among the diverse ML models, Logistic regression and eXtreme Gradient Boosting were the most frequently used, in 22 and 16 studies, respectively. Nine studies performed internal and external validation. Compared with conventional scoring systems such as SOFA, the ML models showed slightly higher performance in predicting mortality (AUROC ranges: 0.62-0.90 vs. 0.47-0.86). CONCLUSIONS ML models demonstrate a modest improvement in predicting sepsis-associated mortality. The certainty of these findings remains low due to the high risk of bias and significant heterogeneity. Studies should include comprehensive methodological details on calibration and hyperparameter selection, adopt a standardized definition of sepsis, and conduct multicenter prospective designs along with external validations.
Collapse
Affiliation(s)
- Nasrin Nikravangolsefid
- Division of Nephrology and Hypertension, Department of Medicine, Mayo Clinic, Rochester, MN, USA; Division of Pulmonary and Critical Care Medicine, Department of Medicine, Mayo Clinic, Rochester, MN, USA
| | - Swetha Reddy
- Division of Pulmonary and Critical Care Medicine, Department of Medicine, Mayo Clinic, Rochester, MN, USA
| | - Hong Hieu Truong
- Division of Nephrology and Hypertension, Department of Medicine, Mayo Clinic, Rochester, MN, USA; Saint Francis Hospital, Department of Medicine, Evanston, IL, USA
| | - Mariam Charkviani
- Division of Nephrology and Hypertension, Department of Medicine, Mayo Clinic, Rochester, MN, USA
| | - Jacob Ninan
- Department of Nephrology and Critical Care, MultiCare Capital Medical Center, Olympia, WA, USA
| | | | - Supawadee Suppadungsuk
- Division of Nephrology and Hypertension, Department of Medicine, Mayo Clinic, Rochester, MN, USA
| | - Waryaam Singh
- Division of Nephrology and Hypertension, Department of Medicine, Mayo Clinic, Rochester, MN, USA
| | - Kianoush B Kashani
- Division of Nephrology and Hypertension, Department of Medicine, Mayo Clinic, Rochester, MN, USA; Division of Pulmonary and Critical Care Medicine, Department of Medicine, Mayo Clinic, Rochester, MN, USA
| | - Juan Pablo Domecq Garces
- Division of Nephrology and Hypertension, Department of Medicine, Mayo Clinic, Rochester, MN, USA; Department of Critical Care Medicine, Mayo Clinic Health System, Mankato, MN, USA.
| |
Collapse
|
2
|
Cocker D, Birgand G, Zhu N, Rodriguez-Manzano J, Ahmad R, Jambo K, Levin AS, Holmes A. Healthcare as a driver, reservoir and amplifier of antimicrobial resistance: opportunities for interventions. Nat Rev Microbiol 2024; 22:636-649. [PMID: 39048837 DOI: 10.1038/s41579-024-01076-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/25/2024] [Indexed: 07/27/2024]
Abstract
Antimicrobial resistance (AMR) is a global health challenge that threatens humans, animals and the environment. Evidence is emerging for a role of healthcare infrastructure, environments and patient pathways in promoting and maintaining AMR via direct and indirect mechanisms. Advances in vaccination and monoclonal antibody therapies together with integrated surveillance, rapid diagnostics, targeted antimicrobial therapy and infection control measures offer opportunities to address healthcare-associated AMR risks more effectively. Additionally, innovations in artificial intelligence, data linkage and intelligent systems can be used to better predict and reduce AMR and improve healthcare resilience. In this Review, we examine the mechanisms by which healthcare functions as a driver, reservoir and amplifier of AMR, contextualized within a One Health framework. We also explore the opportunities and innovative solutions that can be used to combat AMR throughout the patient journey. We provide a perspective on the current evidence for the effectiveness of interventions designed to mitigate healthcare-associated AMR and promote healthcare resilience within high-income and resource-limited settings, as well as the challenges associated with their implementation.
Collapse
Affiliation(s)
- Derek Cocker
- David Price Evans Infectious Diseases & Global Health Group, University of Liverpool, Liverpool, UK
- Malawi-Liverpool-Wellcome Research Programme, Blantyre, Malawi
| | - Gabriel Birgand
- Centre d'appui pour la Prévention des Infections Associées aux Soins, Nantes, France
- National Institute for Health and Care Research (NIHR) Health Protection Research Unit in Healthcare Associated Infections and Antimicrobial Resistance at Imperial College London, London, UK
- Cibles et medicaments des infections et de l'immunitée, IICiMed, Nantes Universite, Nantes, France
| | - Nina Zhu
- National Institute for Health and Care Research (NIHR) Health Protection Research Unit in Healthcare Associated Infections and Antimicrobial Resistance at Imperial College London, London, UK
- Department of Infectious Disease, Imperial College London, London, UK
| | - Jesus Rodriguez-Manzano
- National Institute for Health and Care Research (NIHR) Health Protection Research Unit in Healthcare Associated Infections and Antimicrobial Resistance at Imperial College London, London, UK
- Department of Infectious Disease, Imperial College London, London, UK
| | - Raheelah Ahmad
- National Institute for Health and Care Research (NIHR) Health Protection Research Unit in Healthcare Associated Infections and Antimicrobial Resistance at Imperial College London, London, UK
- Department of Health Services Research & Management, City University of London, London, UK
- Dow University of Health Sciences, Karachi, Pakistan
| | - Kondwani Jambo
- Malawi-Liverpool-Wellcome Research Programme, Blantyre, Malawi
- Department of Clinical Sciences, Liverpool School of Tropical Medicine, Liverpool, UK
| | - Anna S Levin
- Department of Infectious Disease, School of Medicine & Institute of Tropical Medicine, University of São Paulo, São Paulo, Brazil
| | - Alison Holmes
- David Price Evans Infectious Diseases & Global Health Group, University of Liverpool, Liverpool, UK.
- National Institute for Health and Care Research (NIHR) Health Protection Research Unit in Healthcare Associated Infections and Antimicrobial Resistance at Imperial College London, London, UK.
- Department of Infectious Disease, Imperial College London, London, UK.
| |
Collapse
|
3
|
Atwal K. Artificial intelligence in clinical nutrition and dietetics: A brief overview of current evidence. Nutr Clin Pract 2024; 39:736-742. [PMID: 38591653 DOI: 10.1002/ncp.11150] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Revised: 03/07/2024] [Accepted: 03/13/2024] [Indexed: 04/10/2024] Open
Abstract
The rapid surge in artificial intelligence (AI) has dominated technological innovation in today's society. As experts begin to understand the potential, a spectrum of opportunities could yield a remarkable revolution. The upsurge in healthcare could transform clinical interventions and outcomes, but it risks dehumanization and increased unethical practices. The field of clinical nutrition and dietetics is no exception. This article finds a multitude of developments underway, which include the use of AI for malnutrition screening; predicting clinical outcomes, such as disease onset, and clinical risks, such as drug interactions; aiding interventions, such as estimating nutrient intake; applying precision nutrition, such as measuring postprandial glycemic response; and supporting workflow through chatbots trained on natural language models. Although the opportunity and scalability of AI is incalculably attractive, especially in the face of poor healthcare resources, the threat cannot be ignored. The risk of malpractice and lack of accountability are some of the main concerns. As such, the healthcare professional's responsibility remains paramount. The data used to train AI models could be biased, which could risk the quality of care to vulnerable or minority patient groups. Standardized AI-development protocols, benchmarked to care recommendations, with rigorous large-scale validation are required to maximize application among different settings. AI could overturn the healthcare landscape, and this article skims the surface of its potential in clinical nutrition and dietetics.
Collapse
Affiliation(s)
- Kiranjit Atwal
- Department of Nutritional Sciences, King's College London, London, UK
- School of Health Professions, University of Plymouth, Plymouth, UK
| |
Collapse
|
4
|
Otten M, Jagesar AR, Dam TA, Biesheuvel LA, den Hengst F, Ziesemer KA, Thoral PJ, de Grooth HJ, Girbes ARJ, François-Lavet V, Hoogendoorn M, Elbers PWG. Does Reinforcement Learning Improve Outcomes for Critically Ill Patients? A Systematic Review and Level-of-Readiness Assessment. Crit Care Med 2024; 52:e79-e88. [PMID: 37938042 DOI: 10.1097/ccm.0000000000006100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2023]
Abstract
OBJECTIVE Reinforcement learning (RL) is a machine learning technique uniquely effective at sequential decision-making, which makes it potentially relevant to ICU treatment challenges. We set out to systematically review, assess level-of-readiness and meta-analyze the effect of RL on outcomes for critically ill patients. DATA SOURCES A systematic search was performed in PubMed, Embase.com, Clarivate Analytics/Web of Science Core Collection, Elsevier/SCOPUS and the Institute of Electrical and Electronics Engineers Xplore Digital Library from inception to March 25, 2022, with subsequent citation tracking. DATA EXTRACTION Journal articles that used an RL technique in an ICU population and reported on patient health-related outcomes were included for full analysis. Conference papers were included for level-of-readiness assessment only. Descriptive statistics, characteristics of the models, outcome compared with clinician's policy and level-of-readiness were collected. RL-health risk of bias and applicability assessment was performed. DATA SYNTHESIS A total of 1,033 articles were screened, of which 18 journal articles and 18 conference papers, were included. Thirty of those were prototyping or modeling articles and six were validation articles. All articles reported RL algorithms to outperform clinical decision-making by ICU professionals, but only in retrospective data. The modeling techniques for the state-space, action-space, reward function, RL model training, and evaluation varied widely. The risk of bias was high in all articles, mainly due to the evaluation procedure. CONCLUSION In this first systematic review on the application of RL in intensive care medicine we found no studies that demonstrated improved patient outcomes from RL-based technologies. All studies reported that RL-agent policies outperformed clinician policies, but such assessments were all based on retrospective off-policy evaluation.
Collapse
Affiliation(s)
- Martijn Otten
- Department of Intensive Care Medicine, Center for Critical Care Computational Intelligence, Amsterdam Medical Data Science (AMDS), Amsterdam Cardiovascular Science (ACS), Amsterdam UMC, Vrije Universiteit, Amsterdam, The Netherlands
- Quantitative Data Analytics Group, Department of Computer Science, Faculty of Science, Vrije Universiteit, Amsterdam, The Netherlands
| | - Ameet R Jagesar
- Department of Intensive Care Medicine, Center for Critical Care Computational Intelligence, Amsterdam Medical Data Science (AMDS), Amsterdam Cardiovascular Science (ACS), Amsterdam UMC, Vrije Universiteit, Amsterdam, The Netherlands
- Quantitative Data Analytics Group, Department of Computer Science, Faculty of Science, Vrije Universiteit, Amsterdam, The Netherlands
| | - Tariq A Dam
- Department of Intensive Care Medicine, Center for Critical Care Computational Intelligence, Amsterdam Medical Data Science (AMDS), Amsterdam Cardiovascular Science (ACS), Amsterdam UMC, Vrije Universiteit, Amsterdam, The Netherlands
- Quantitative Data Analytics Group, Department of Computer Science, Faculty of Science, Vrije Universiteit, Amsterdam, The Netherlands
| | - Laurens A Biesheuvel
- Department of Intensive Care Medicine, Center for Critical Care Computational Intelligence, Amsterdam Medical Data Science (AMDS), Amsterdam Cardiovascular Science (ACS), Amsterdam UMC, Vrije Universiteit, Amsterdam, The Netherlands
- Quantitative Data Analytics Group, Department of Computer Science, Faculty of Science, Vrije Universiteit, Amsterdam, The Netherlands
| | - Floris den Hengst
- Quantitative Data Analytics Group, Department of Computer Science, Faculty of Science, Vrije Universiteit, Amsterdam, The Netherlands
| | | | - Patrick J Thoral
- Department of Intensive Care Medicine, Center for Critical Care Computational Intelligence, Amsterdam Medical Data Science (AMDS), Amsterdam Cardiovascular Science (ACS), Amsterdam UMC, Vrije Universiteit, Amsterdam, The Netherlands
| | - Harm-Jan de Grooth
- Department of Intensive Care Medicine, Center for Critical Care Computational Intelligence, Amsterdam Medical Data Science (AMDS), Amsterdam Cardiovascular Science (ACS), Amsterdam UMC, Vrije Universiteit, Amsterdam, The Netherlands
| | - Armand R J Girbes
- Department of Intensive Care Medicine, Center for Critical Care Computational Intelligence, Amsterdam Medical Data Science (AMDS), Amsterdam Cardiovascular Science (ACS), Amsterdam UMC, Vrije Universiteit, Amsterdam, The Netherlands
| | - Vincent François-Lavet
- Quantitative Data Analytics Group, Department of Computer Science, Faculty of Science, Vrije Universiteit, Amsterdam, The Netherlands
| | - Mark Hoogendoorn
- Quantitative Data Analytics Group, Department of Computer Science, Faculty of Science, Vrije Universiteit, Amsterdam, The Netherlands
| | - Paul W G Elbers
- Department of Intensive Care Medicine, Center for Critical Care Computational Intelligence, Amsterdam Medical Data Science (AMDS), Amsterdam Cardiovascular Science (ACS), Amsterdam UMC, Vrije Universiteit, Amsterdam, The Netherlands
| |
Collapse
|
5
|
Zhang Y, Xu W, Yang P, Zhang A. Machine learning for the prediction of sepsis-related death: a systematic review and meta-analysis. BMC Med Inform Decis Mak 2023; 23:283. [PMID: 38082381 PMCID: PMC10712076 DOI: 10.1186/s12911-023-02383-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Accepted: 11/28/2023] [Indexed: 12/18/2023] Open
Abstract
BACKGROUND AND OBJECTIVES Sepsis is accompanied by a considerably high risk of mortality in the short term, despite the availability of recommended mortality risk assessment tools. However, these risk assessment tools seem to have limited predictive value. With the gradual integration of machine learning into clinical practice, some researchers have attempted to employ machine learning for early mortality risk prediction in sepsis patients. Nevertheless, there is a lack of comprehensive understanding regarding the construction of predictive variables using machine learning and the value of various machine learning methods. Thus, we carried out this systematic review and meta-analysis to explore the predictive value of machine learning for sepsis-related death at different time points. METHODS PubMed, Embase, Cochrane, and Web of Science databases were searched until August 9th, 2022. The risk of bias in predictive models was assessed using the Prediction model Risk of Bias Assessment Tool (PROBAST). We also performed subgroup analysis according to time of death and type of model and summarized current predictive variables used to construct models for sepsis death prediction. RESULTS Fifty original studies were included, covering 104 models. The combined Concordance index (C-index), sensitivity, and specificity of machine learning models were 0.799, 0.81, and 0.80 in the training set, and 0.774, 0.71, and 0.68 in the validation set, respectively. Machine learning outperformed conventional clinical scoring tools and showed excellent C-index, sensitivity, and specificity in different subgroups. Random Forest (RF) and eXtreme Gradient Boosting (XGBoost) are the preferred machine learning models because they showed more favorable accuracy with similar modeling variables. This study found that lactate was the most frequent predictor but was seriously ignored by current clinical scoring tools. CONCLUSION Machine learning methods demonstrate relatively favorable accuracy in predicting the mortality risk in sepsis patients. Given the limitations in accuracy and applicability of existing prediction scoring systems, there is an opportunity to explore updates based on existing machine learning approaches. Specifically, it is essential to develop or update more suitable mortality risk assessment tools based on the specific contexts of use, such as emergency departments, general wards, and intensive care units.
Collapse
Affiliation(s)
- Yan Zhang
- Department of Critical Care Medicine, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, 400010, China
| | - Weiwei Xu
- Department of Endocrine and Metabolic Diseases, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, 400010, China
| | - Ping Yang
- Department of Critical Care Medicine, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, 400010, China.
| | - An Zhang
- Department of Critical Care Medicine, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, 400010, China.
| |
Collapse
|
6
|
Liu R, Hunold KM, Caterino JM, Zhang P. Estimating treatment effects for time-to-treatment antibiotic stewardship in sepsis. NAT MACH INTELL 2023; 5:421-431. [PMID: 37125081 PMCID: PMC10135432 DOI: 10.1038/s42256-023-00638-0] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2021] [Accepted: 03/02/2023] [Indexed: 05/02/2023]
Abstract
Sepsis is a life-threatening condition with a high in-hospital mortality rate. The timing of antibiotic administration poses a critical problem for sepsis management. Existing work studying antibiotic timing either ignores the temporality of the observational data or the heterogeneity of the treatment effects. Here we propose a novel method (called T4) to estimate treatment effects for time-to-treatment antibiotic stewardship in sepsis. T4 estimates individual treatment effects by recurrently encoding temporal and static variables as potential confounders, and then decoding the outcomes under different treatment sequences. We propose mini-batch balancing matching that mimics the randomized controlled trial process to adjust the confounding. The model achieves interpretability through a global-level attention mechanism and a variable-level importance examination. Meanwhile, we equip T4 with an uncertainty quantification to help prevent overconfident recommendations. We demonstrate that T4 can identify effective treatment timing with estimated individual treatment effects for antibiotic stewardship on two real-world datasets. Moreover, comprehensive experiments on a synthetic dataset exhibit the outstanding performance of T4 compared with the state-of-the-art models on estimation of individual treatment effect.
Collapse
Affiliation(s)
- Ruoqi Liu
- Department of Computer Science and Engineering, The Ohio State University, Columbus, OH, USA
| | - Katherine M. Hunold
- Department of Emergency Medicine, The Ohio State University, Columbus, OH, USA
| | - Jeffrey M. Caterino
- Department of Emergency Medicine, The Ohio State University, Columbus, OH, USA
| | - Ping Zhang
- Department of Computer Science and Engineering, The Ohio State University, Columbus, OH, USA
- Department of Biomedical Informatics, The Ohio State University, Columbus, OH, USA
- Translational Data Analytics institute, The Ohio State University, Columbus, OH, USA
| |
Collapse
|
7
|
Artificial Intelligence for Antimicrobial Resistance Prediction: Challenges and Opportunities towards Practical Implementation. Antibiotics (Basel) 2023; 12:antibiotics12030523. [PMID: 36978390 PMCID: PMC10044311 DOI: 10.3390/antibiotics12030523] [Citation(s) in RCA: 23] [Impact Index Per Article: 23.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Revised: 03/01/2023] [Accepted: 03/03/2023] [Indexed: 03/08/2023] Open
Abstract
Antimicrobial resistance (AMR) is emerging as a potential threat to many lives worldwide. It is very important to understand and apply effective strategies to counter the impact of AMR and its mutation from a medical treatment point of view. The intersection of artificial intelligence (AI), especially deep learning/machine learning, has led to a new direction in antimicrobial identification. Furthermore, presently, the availability of huge amounts of data from multiple sources has made it more effective to use these artificial intelligence techniques to identify interesting insights into AMR genes such as new genes, mutations, drug identification, conditions favorable to spread, and so on. Therefore, this paper presents a review of state-of-the-art challenges and opportunities. These include interesting input features posing challenges in use, state-of-the-art deep-learning/machine-learning models for robustness and high accuracy, challenges, and prospects to apply these techniques for practical purposes. The paper concludes with the encouragement to apply AI to the AMR sector with the intention of practical diagnosis and treatment, since presently most studies are at early stages with minimal application in the practice of diagnosis and treatment of disease.
Collapse
|
8
|
The treatment of sepsis: an episodic memory-assisted deep reinforcement learning approach. APPL INTELL 2022. [DOI: 10.1007/s10489-022-04099-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
9
|
An early prediction model for canine chronic kidney disease based on routine clinical laboratory tests. Sci Rep 2022; 12:14489. [PMID: 36008537 PMCID: PMC9411602 DOI: 10.1038/s41598-022-18793-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2021] [Accepted: 08/19/2022] [Indexed: 11/08/2022] Open
Abstract
The aim of this study was to derive a model to predict the risk of dogs developing chronic kidney disease (CKD) using data from electronic health records (EHR) collected during routine veterinary practice. Data from 57,402 dogs were included in the study. Two thirds of the EHRs were used to build the model, which included feature selection and identification of the optimal neural network type and architecture. The remaining unseen EHRs were used to evaluate model performance. The final model was a recurrent neural network with 6 features (creatinine, blood urea nitrogen, urine specific gravity, urine protein, weight, age). Identifying CKD at the time of diagnosis, the model displayed a sensitivity of 91.4% and a specificity of 97.2%. When predicting future risk of CKD, model sensitivity was 68.8% at 1 year, and 44.8% 2 years before diagnosis. Positive predictive value (PPV) varied between 15 and 23% and was influenced by the age of the patient, while the negative predictive value remained above 99% under all tested conditions. While the modest PPV limits its use as a stand-alone diagnostic screening tool, high specificity and NPV make the model particularly effective at identifying patients that will not go on to develop CKD.
Collapse
|
10
|
Rosenstrom E, Meshkinfam S, Ivy JS, Goodarzi SH, Capan M, Huddleston J, Romero-Brufau S. Optimizing the First Response to Sepsis: An Electronic Health Record-Based Markov Decision Process Model. DECISION ANALYSIS 2022. [DOI: 10.1287/deca.2022.0455] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Abstract
Sepsis is considered a medical emergency where delays in initial treatment are associated with increased morbidity and mortality, yet there is no gold standard for identifying sepsis onset and thus treatment timing. We leverage electronic health record (EHR) data with clinical expertise to develop a continuous-time Markov decision process (MDP) optimal stopping model that identifies the optimal first intervention action (anti-infective, fluid, or wait). To study the impact of initial treatment of patients at risk for developing sepsis, we define the delayed treatment population who received delayed treatment upon admission or during hospitalization and serves as an approximation of the natural history of sepsis. We apply the optimal first treatment policy to sample patient visits from the nondelayed treatment population. This analysis indicates the average risk of death could be reduced by approximately 2.2%, the average time until treatment could be reduced by 106 minutes, and the average severity of the treatment state could be reduced by 15.5% compared with the treatment they received in the hospital. We study the properties of the optimal policy to define an easily interpretable initial treatment heuristic that considers a patient’s organ dysfunction, location, and septic shock status. This generalizable framework can inform personalized treatment of patients at risk for sepsis.
Collapse
Affiliation(s)
- Erik Rosenstrom
- Department of Industrial and Systems Engineering, North Carolina State University, Raleigh, North Carolina 27606
| | - Sareh Meshkinfam
- Department of Industrial and Systems Engineering, North Carolina State University, Raleigh, North Carolina 27606
- Dynamic Ideas LLC, Waltham, Massachusetts 02452
| | - Julie Simmons Ivy
- Department of Industrial and Systems Engineering, North Carolina State University, Raleigh, North Carolina 27606
| | - Shadi Hassani Goodarzi
- Department of Industrial and Systems Engineering, North Carolina State University, Raleigh, North Carolina 27606
| | - Muge Capan
- Department of Mechanical and Industrial Engineering, University of Massachusetts Amherst, Amherst, Massachusetts 01003
| | - Jeanne Huddleston
- Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery, Mayo Clinic, Rochester, Minnesota 55902
| | - Santiago Romero-Brufau
- Department of Otolaryngology (ENT) / Head and Neck Surgery, Mayo Clinic, Rochester, Minnesota 55902
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Harvard University, Boston, Massachusetts 02115
| |
Collapse
|
11
|
Park JY, Hsu TC, Hu JR, Chen CY, Hsu WT, Lee M, Ho J, Lee CC. Predicting Sepsis Mortality in a Population-Based National Database: Machine Learning Approach. J Med Internet Res 2022; 24:e29982. [PMID: 35416785 PMCID: PMC9047761 DOI: 10.2196/29982] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2021] [Revised: 09/07/2021] [Accepted: 03/06/2022] [Indexed: 01/20/2023] Open
Abstract
BACKGROUND Although machine learning (ML) algorithms have been applied to point-of-care sepsis prognostication, ML has not been used to predict sepsis mortality in an administrative database. Therefore, we examined the performance of common ML algorithms in predicting sepsis mortality in adult patients with sepsis and compared it with that of the conventional context knowledge-based logistic regression approach. OBJECTIVE The aim of this study is to examine the performance of common ML algorithms in predicting sepsis mortality in adult patients with sepsis and compare it with that of the conventional context knowledge-based logistic regression approach. METHODS We examined inpatient admissions for sepsis in the US National Inpatient Sample using hospitalizations in 2010-2013 as the training data set. We developed four ML models to predict in-hospital mortality: logistic regression with least absolute shrinkage and selection operator regularization, random forest, gradient-boosted decision tree, and deep neural network. To estimate their performance, we compared our models with the Super Learner model. Using hospitalizations in 2014 as the testing data set, we examined the models' area under the receiver operating characteristic curve (AUC), confusion matrix results, and net reclassification improvement. RESULTS Hospitalizations of 923,759 adults were included in the analysis. Compared with the reference logistic regression (AUC: 0.786, 95% CI 0.783-0.788), all ML models showed superior discriminative ability (P<.001), including logistic regression with least absolute shrinkage and selection operator regularization (AUC: 0.878, 95% CI 0.876-0.879), random forest (AUC: 0.878, 95% CI 0.877-0.880), xgboost (AUC: 0.888, 95% CI 0.886-0.889), and neural network (AUC: 0.893, 95% CI 0.891-0.895). All 4 ML models showed higher sensitivity, specificity, positive predictive value, and negative predictive value compared with the reference logistic regression model (P<.001). We obtained similar results from the Super Learner model (AUC: 0.883, 95% CI 0.881-0.885). CONCLUSIONS ML approaches can improve sensitivity, specificity, positive predictive value, negative predictive value, discrimination, and calibration in predicting in-hospital mortality in patients hospitalized with sepsis in the United States. These models need further validation and could be applied to develop more accurate models to compare risk-standardized mortality rates across hospitals and geographic regions, paving the way for research and policy initiatives studying disparities in sepsis care.
Collapse
Affiliation(s)
- James Yeongjun Park
- Department of Biostatistics, Harvard TH Chan School of Public Health, Boston, MA, United States
| | - Tzu-Chun Hsu
- Department of Emergency Medicine, National Taiwan University Hospital, Taipei, Taiwan
| | - Jiun-Ruey Hu
- Department of Internal Medicine, Yale School of Medicine, New Haven, CT, United States
| | - Chun-Yuan Chen
- Department of Medicine, National Taiwan University, Taipei, Taiwan
| | - Wan-Ting Hsu
- Department of Epidemiology, Harvard TH Chan School of Public Health, Boston, MA, United States.,Medical Wizdom, LLC, Brookline, MA, United States
| | - Matthew Lee
- Medical Wizdom, LLC, Brookline, MA, United States
| | - Joshua Ho
- Center of Intelligent Healthcare, National Taiwan University Hospital, Taipei, Taiwan
| | - Chien-Chang Lee
- Department of Emergency Medicine, National Taiwan University Hospital, Taipei, Taiwan.,Center of Intelligent Healthcare, National Taiwan University Hospital, Taipei, Taiwan
| |
Collapse
|
12
|
Ocampo-Quintero N, Vidal-Cortés P, Del Río Carbajo L, Fdez-Riverola F, Reboiro-Jato M, Glez-Peña D. Enhancing sepsis management through machine learning techniques: A review. Med Intensiva 2022; 46:140-156. [PMID: 35221003 DOI: 10.1016/j.medine.2020.04.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2019] [Accepted: 04/05/2020] [Indexed: 06/14/2023]
Abstract
Sepsis is a major public health problem and a leading cause of death in the world, where delay in the beginning of treatment, along with clinical guidelines non-adherence have been proved to be associated with higher mortality. Machine Learning is increasingly being adopted in developing innovative Clinical Decision Support Systems in many areas of medicine, showing a great potential for automatic prediction of diverse patient conditions, as well as assistance in clinical decision making. In this context, this work conducts a narrative review to provide an overview of how specific Machine Learning techniques can be used to improve sepsis management, discussing the main tasks addressed, the most popular methods and techniques, as well as the obtained results, in terms of both intelligent system accuracy and clinical outcomes improvement.
Collapse
Affiliation(s)
- N Ocampo-Quintero
- ESEI - Escuela Superior de Ingeniería Informática, Universidad de Vigo, Ourense, Spain
| | - P Vidal-Cortés
- Intensive Care Unit, Complexo Hospitalario Universitario de Ourense, Ourense, Spain
| | - L Del Río Carbajo
- Intensive Care Unit, Complexo Hospitalario Universitario de Ourense, Ourense, Spain
| | - F Fdez-Riverola
- ESEI - Escuela Superior de Ingeniería Informática, Universidad de Vigo, Ourense, Spain; CINBIO - Centro de Investigaciones Biomédicas, Universidad de Vigo, Vigo, Spain; SING Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, Spain
| | - M Reboiro-Jato
- ESEI - Escuela Superior de Ingeniería Informática, Universidad de Vigo, Ourense, Spain; CINBIO - Centro de Investigaciones Biomédicas, Universidad de Vigo, Vigo, Spain; SING Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, Spain
| | - D Glez-Peña
- ESEI - Escuela Superior de Ingeniería Informática, Universidad de Vigo, Ourense, Spain; CINBIO - Centro de Investigaciones Biomédicas, Universidad de Vigo, Vigo, Spain; SING Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, Spain.
| |
Collapse
|
13
|
Parra-Rodriguez L, Guillamet MCV. Antibiotic Decision-Making in the ICU. Semin Respir Crit Care Med 2022; 43:141-149. [PMID: 35172364 DOI: 10.1055/s-0041-1741014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
It is well established that Intensive Care Units (ICUs) are a focal point in antimicrobial consumption with a major influence on the ecological consequences of antibiotic use. With the high prevalence and mortality of infections in critically ill patients, and the clinical challenges of treating patients with septic shock, the impact of real life clinical decisions made by intensivists becomes more significant. Both under- and over-treatment with unnecessarily broad spectrum antibiotics can lead to detrimental outcomes. Even though substantial progress has been made in developing rapid diagnostic tests that can help guide antibiotic use, there is still a time window when clinicians must decide the empiric antibiotic treatment with insufficient clinical data. The continuous streams of data available in the ICU environment make antimicrobial optimization an ongoing challenge for clinicians but at the same time can serve as the input for sophisticated models. In this review, we summarize the evidence to help guide antibiotic decision-making in the ICU. We focus on 1) deciding IF: to start antibiotics, 2) choosing the spectrum of the empiric agents to use, and 3) de-escalating the chosen empiric antibiotics. We provide a perspective on the role of machine learning and artificial intelligence models for clinical decision support systems that can be incorporated seamlessly into clinical practice in order to improve the antibiotic selection process and, more importantly, current and future patients' outcomes.
Collapse
Affiliation(s)
- Luis Parra-Rodriguez
- Division of Infectious Diseases, Department of Medicine, Washington University School of Medicine, St. Louis, Missouri
| | - M Cristina Vazquez Guillamet
- Division of Infectious Diseases, Department of Medicine, Washington University School of Medicine, St. Louis, Missouri.,Division of Pulmonary and Critical Care Medicine, Department of Medicine, Washington University School of Medicine, St. Louis, Missouri
| |
Collapse
|
14
|
Wang R, Liu J, Chen Z, Gong M, Li C, Guo W. The Transition Law of Sepsis Patients’ Illness States Based on Complex Network. Artif Intell Med 2022. [DOI: 10.1007/978-3-031-09342-5_31] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
|
15
|
Bishop JA, Javed HA, el-Bouri R, Zhu T, Taylor T, Peto T, Watkinson P, Eyre DW, Clifton DA. Improving patient flow during infectious disease outbreaks using machine learning for real-time prediction of patient readiness for discharge. PLoS One 2021; 16:e0260476. [PMID: 34813632 PMCID: PMC8610279 DOI: 10.1371/journal.pone.0260476] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2021] [Accepted: 11/10/2021] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND Delays in patient flow and a shortage of hospital beds are commonplace in hospitals during periods of increased infection incidence, such as seasonal influenza and the COVID-19 pandemic. The objective of this study was to develop and evaluate the efficacy of machine learning methods at identifying and ranking the real-time readiness of individual patients for discharge, with the goal of improving patient flow within hospitals during periods of crisis. METHODS AND PERFORMANCE Electronic Health Record data from Oxford University Hospitals was used to train independent models to classify and rank patients' real-time readiness for discharge within 24 hours, for patient subsets according to the nature of their admission (planned or emergency) and the number of days elapsed since their admission. A strategy for the use of the models' inference is proposed, by which the model makes predictions for all patients in hospital and ranks them in order of likelihood of discharge within the following 24 hours. The 20% of patients with the highest ranking are considered as candidates for discharge and would therefore expect to have a further screening by a clinician to confirm whether they are ready for discharge or not. Performance was evaluated in terms of positive predictive value (PPV), i.e., the proportion of these patients who would have been correctly deemed as 'ready for discharge' after having the second screening by a clinician. Performance was high for patients on their first day of admission (PPV = 0.96/0.94 for planned/emergency patients respectively) but dropped for patients further into a longer admission (PPV = 0.66/0.71 for planned/emergency patients still in hospital after 7 days). CONCLUSION We demonstrate the efficacy of machine learning methods at making operationally focused, next-day discharge readiness predictions for all individual patients in hospital at any given moment and propose a strategy for their use within a decision-support tool during crisis periods.
Collapse
Affiliation(s)
- Jennifer A. Bishop
- Department of Engineering Science, University of Oxford, Oxford, United Kingdom
| | - Hamza A. Javed
- Department of Engineering Science, University of Oxford, Oxford, United Kingdom
| | - Rasheed el-Bouri
- Department of Engineering Science, University of Oxford, Oxford, United Kingdom
| | - Tingting Zhu
- Department of Engineering Science, University of Oxford, Oxford, United Kingdom
| | - Thomas Taylor
- Department of Engineering Science, University of Oxford, Oxford, United Kingdom
| | - Tim Peto
- Oxford University Hospitals NHS Foundation Trust, Oxford, United Kingdom
| | - Peter Watkinson
- Oxford University Hospitals NHS Foundation Trust, Oxford, United Kingdom
| | - David W. Eyre
- Oxford University Hospitals NHS Foundation Trust, Oxford, United Kingdom
- Big Data Institute, Nuffield Department of Population Health, University of Oxford, Oxford, United Kingdom
| | - David A. Clifton
- Department of Engineering Science, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
16
|
Giordano C, Brennan M, Mohamed B, Rashidi P, Modave F, Tighe P. Accessing Artificial Intelligence for Clinical Decision-Making. Front Digit Health 2021; 3:645232. [PMID: 34713115 PMCID: PMC8521931 DOI: 10.3389/fdgth.2021.645232] [Citation(s) in RCA: 75] [Impact Index Per Article: 25.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2020] [Accepted: 06/01/2021] [Indexed: 11/13/2022] Open
Abstract
Advancements in computing and data from the near universal acceptance and implementation of electronic health records has been formative for the growth of personalized, automated, and immediate patient care models that were not previously possible. Artificial intelligence (AI) and its subfields of machine learning, reinforcement learning, and deep learning are well-suited to deal with such data. The authors in this paper review current applications of AI in clinical medicine and discuss the most likely future contributions that AI will provide to the healthcare industry. For instance, in response to the need to risk stratify patients, appropriately cultivated and curated data can assist decision-makers in stratifying preoperative patients into risk categories, as well as categorizing the severity of ailments and health for non-operative patients admitted to hospitals. Previous overt, traditional vital signs and laboratory values that are used to signal alarms for an acutely decompensating patient may be replaced by continuously monitoring and updating AI tools that can pick up early imperceptible patterns predicting subtle health deterioration. Furthermore, AI may help overcome challenges with multiple outcome optimization limitations or sequential decision-making protocols that limit individualized patient care. Despite these tremendously helpful advancements, the data sets that AI models train on and develop have the potential for misapplication and thereby create concerns for application bias. Subsequently, the mechanisms governing this disruptive innovation must be understood by clinical decision-makers to prevent unnecessary harm. This need will force physicians to change their educational infrastructure to facilitate understanding AI platforms, modeling, and limitations to best acclimate practice in the age of AI. By performing a thorough narrative review, this paper examines these specific AI applications, limitations, and requisites while reviewing a few examples of major data sets that are being cultivated and curated in the US.
Collapse
Affiliation(s)
- Chris Giordano
- Department of Anesthesiology, University of Florida College of Medicine, Gainesville, FL, United States
| | - Meghan Brennan
- Department of Anesthesiology, University of Florida College of Medicine, Gainesville, FL, United States
| | - Basma Mohamed
- Department of Anesthesiology, University of Florida College of Medicine, Gainesville, FL, United States
| | - Parisa Rashidi
- J. Clayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL, United States
| | - François Modave
- Department of Health Outcomes & Biomedical Informatics, University of Florida College of Medicine, Gainesville, FL, United States
| | - Patrick Tighe
- Department of Anesthesiology, University of Florida College of Medicine, Gainesville, FL, United States
| |
Collapse
|
17
|
Jazayeri A, Capan M, Ivy J, Arnold R, Yang CC. Proximity of Cellular and Physiological Response Failures in Sepsis. IEEE J Biomed Health Inform 2021; 25:4089-4097. [PMID: 34288881 DOI: 10.1109/jbhi.2021.3098428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Sepsis is a devastating multi-stage health condition with a high mortality rate. Its complexity, prevalence, and dependency of its outcomes on early detection have attracted substantial attention from data science and machine learning communities. Previous studies rely on individual cellular and physiological responses representing organ system failures to predict health outcomes or the onset of different sepsis stages. However, it is known that organ systems' failures and dynamics are not independent events. In this study, we identify the dependency patterns of significant proximate sepsis-related failures of cellular and physiological responses using data from 12,223 adult patients hospitalized between July 2013 and December 2015. The results show that proximate failures of cellular and physiological responses create better feature sets for outcome prediction than individual responses. Our findings reveal the few significant proximate failures that play the major roles in predicting patients' outcomes. This study's results can be simply translated into clinical practices and inform the prediction and improvement of patients' conditions and outcomes.
Collapse
|
18
|
Applications of Machine Learning to the Problem of Antimicrobial Resistance: an Emerging Model for Translational Research. J Clin Microbiol 2021; 59:e0126020. [PMID: 33536291 DOI: 10.1128/jcm.01260-20] [Citation(s) in RCA: 58] [Impact Index Per Article: 19.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023] Open
Abstract
Antimicrobial resistance (AMR) remains one of the most challenging phenomena of modern medicine. Machine learning (ML) is a subfield of artificial intelligence that focuses on the development of algorithms that learn how to accurately predict outcome variables using large sets of predictor variables that are typically not hand selected and are minimally curated. Models are parameterized using a training data set and then applied to a test data set on which predictive performance is evaluated. The application of ML algorithms to the problem of AMR has garnered increasing interest in the past 5 years due to the exponential growth of experimental and clinical data, heavy investment in computational capacity, improvements in algorithm performance, and increasing urgency for innovative approaches to reducing the burden of disease. Here, we review the current state of research at the intersection of ML and AMR with an emphasis on three domains of work. The first is the prediction of AMR using genomic data. The second is the use of ML to gain insight into the cellular functions disrupted by antibiotics, which forms the basis for understanding mechanisms of action and developing novel anti-infectives. The third focuses on the application of ML for antimicrobial stewardship using data extracted from the electronic health record. Although the use of ML for understanding, diagnosing, treating, and preventing AMR is still in its infancy, the continued growth of data and interest ensures it will become an important tool for future translational research programs.
Collapse
|
19
|
Schwartz JM, Moy AJ, Rossetti SC, Elhadad N, Cato KD. Clinician involvement in research on machine learning-based predictive clinical decision support for the hospital setting: A scoping review. J Am Med Inform Assoc 2021; 28:653-663. [PMID: 33325504 PMCID: PMC7936403 DOI: 10.1093/jamia/ocaa296] [Citation(s) in RCA: 30] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2020] [Accepted: 11/30/2020] [Indexed: 01/03/2023] Open
Abstract
OBJECTIVE The study sought to describe the prevalence and nature of clinical expert involvement in the development, evaluation, and implementation of clinical decision support systems (CDSSs) that utilize machine learning to analyze electronic health record data to assist nurses and physicians in prognostic and treatment decision making (ie, predictive CDSSs) in the hospital. MATERIALS AND METHODS A systematic search of PubMed, CINAHL, and IEEE Xplore and hand-searching of relevant conference proceedings were conducted to identify eligible articles. Empirical studies of predictive CDSSs using electronic health record data for nurses or physicians in the hospital setting published in the last 5 years in peer-reviewed journals or conference proceedings were eligible for synthesis. Data from eligible studies regarding clinician involvement, stage in system design, predictive CDSS intention, and target clinician were charted and summarized. RESULTS Eighty studies met eligibility criteria. Clinical expert involvement was most prevalent at the beginning and late stages of system design. Most articles (95%) described developing and evaluating machine learning models, 28% of which described involving clinical experts, with nearly half functioning to verify the clinical correctness or relevance of the model (47%). DISCUSSION Involvement of clinical experts in predictive CDSS design should be explicitly reported in publications and evaluated for the potential to overcome predictive CDSS adoption challenges. CONCLUSIONS If present, clinical expert involvement is most prevalent when predictive CDSS specifications are made or when system implementations are evaluated. However, clinical experts are less prevalent in developmental stages to verify clinical correctness, select model features, preprocess data, or serve as a gold standard.
Collapse
Affiliation(s)
| | - Amanda J Moy
- Department of Biomedical Informatics, Columbia University, New York, New York, USA
| | - Sarah C Rossetti
- School of Nursing, Columbia University, New York, New York, USA
- Department of Biomedical Informatics, Columbia University, New York, New York, USA
| | - Noémie Elhadad
- Department of Biomedical Informatics, Columbia University, New York, New York, USA
| | - Kenrick D Cato
- School of Nursing, Columbia University, New York, New York, USA
- Department of Emergency Medicine, Columbia University, New York, New York, USA
| |
Collapse
|
20
|
Fenner BP, Darden DB, Kelly LS, Rincon J, Brakenridge SC, Larson SD, Moore FA, Efron PA, Moldawer LL. Immunological Endotyping of Chronic Critical Illness After Severe Sepsis. Front Med (Lausanne) 2021; 7:616694. [PMID: 33659259 PMCID: PMC7917137 DOI: 10.3389/fmed.2020.616694] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2020] [Accepted: 12/14/2020] [Indexed: 12/15/2022] Open
Abstract
Improved management of severe sepsis has been one of the major health care accomplishments of the last two decades. Due to enhanced recognition and improved management of severe sepsis, in-hospital mortality has been reduced by up to 40%. With that good news, a new syndrome has unfortunately replaced in-hospital multi-organ failure and death. This syndrome of chronic critical illness (CCI) includes sepsis patients who survive the early "cytokine or genomic storm," but fail to fully recover, and progress into a persistent state of manageable organ injury requiring prolonged intensive care. These patients are commonly discharged to long-term care facilities where sepsis recidivism is high. As many as 33% of sepsis survivors develop CCI. CCI is the result, at least in part, of a maladaptive host response to chronic pattern-recognition receptor (PRR)-mediated processes. This maladaptive response results in dysregulated myelopoiesis, chronic inflammation, T-cell atrophy, T-cell exhaustion, and the expansion of suppressor cell functions. We have defined this panoply of host responses as a persistent inflammatory, immune suppressive and protein catabolic syndrome (PICS). Why is this important? We propose that PICS in survivors of critical illness is its own common, unique immunological endotype driven by the constant release of organ injury-associated, endogenous alarmins, and microbial products from secondary infections. While this syndrome can develop as a result of a diverse set of pathologies, it represents a shared outcome with a unique underlying pathobiological mechanism. Despite being a common outcome, there are no therapeutic interventions other than supportive therapies for this common disorder. Only through an improved understanding of the immunological endotype of PICS can rational therapeutic interventions be designed.
Collapse
Affiliation(s)
- Brittany P Fenner
- Department of Surgery, Sepsis and Critical Illness Research Center, University of Florida College of Medicine, Gainesville, FL, United States
| | - D B Darden
- Department of Surgery, Sepsis and Critical Illness Research Center, University of Florida College of Medicine, Gainesville, FL, United States
| | - Lauren S Kelly
- Department of Surgery, Sepsis and Critical Illness Research Center, University of Florida College of Medicine, Gainesville, FL, United States
| | - Jaimar Rincon
- Department of Surgery, Sepsis and Critical Illness Research Center, University of Florida College of Medicine, Gainesville, FL, United States
| | - Scott C Brakenridge
- Department of Surgery, Sepsis and Critical Illness Research Center, University of Florida College of Medicine, Gainesville, FL, United States
| | - Shawn D Larson
- Department of Surgery, Sepsis and Critical Illness Research Center, University of Florida College of Medicine, Gainesville, FL, United States
| | - Frederick A Moore
- Department of Surgery, Sepsis and Critical Illness Research Center, University of Florida College of Medicine, Gainesville, FL, United States
| | - Philip A Efron
- Department of Surgery, Sepsis and Critical Illness Research Center, University of Florida College of Medicine, Gainesville, FL, United States
| | - Lyle L Moldawer
- Department of Surgery, Sepsis and Critical Illness Research Center, University of Florida College of Medicine, Gainesville, FL, United States
| |
Collapse
|
21
|
Chicco D, Oneto L. Data analytics and clinical feature ranking of medical records of patients with sepsis. BioData Min 2021; 14:12. [PMID: 33536030 PMCID: PMC7860202 DOI: 10.1186/s13040-021-00235-0] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2020] [Accepted: 01/05/2021] [Indexed: 12/15/2022] Open
Abstract
Background Sepsis is a life-threatening clinical condition that happens when the patient’s body has an excessive reaction to an infection, and should be treated in one hour. Due to the urgency of sepsis, doctors and physicians often do not have enough time to perform laboratory tests and analyses to help them forecast the consequences of the sepsis episode. In this context, machine learning can provide a fast computational prediction of sepsis severity, patient survival, and sequential organ failure by just analyzing the electronic health records of the patients. Also, machine learning can be employed to understand which features in the medical records are more predictive of sepsis severity, of patient survival, and of sequential organ failure in a fast and non-invasive way. Dataset and methods In this study, we analyzed a dataset of electronic health records of 364 patients collected between 2014 and 2016. The medical record of each patient has 29 clinical features, and includes a binary value for survival, a binary value for septic shock, and a numerical value for the sequential organ failure assessment (SOFA) score. We disjointly utilized each of these three factors as an independent target, and employed several machine learning methods to predict it (binary classifiers for survival and septic shock, and regression analysis for the SOFA score). Afterwards, we used a data mining approach to identify the most important dataset features in relation to each of the three targets separately, and compared these results with the results achieved through a standard biostatistics approach. Results and conclusions Our results showed that machine learning can be employed efficiently to predict septic shock, SOFA score, and survival of patients diagnoses with sepsis, from their electronic health records data. And regarding clinical feature ranking, our results showed that Random Forests feature selection identified several unexpected symptoms and clinical components as relevant for septic shock, SOFA score, and survival. These discoveries can help doctors and physicians in understanding and predicting septic shock. We made the analyzed dataset and our developed software code publicly available online. Supplementary Information The online version contains supplementary material available at (10.1186/s13040-021-00235-0).
Collapse
Affiliation(s)
- Davide Chicco
- Krembil Research Institute, Toronto, Ontario, Canada.
| | - Luca Oneto
- Università di Genova, Genoa, Italy.,ZenaByte srl, Genoa, Italy
| |
Collapse
|
22
|
Sakib N, Ahamed SI, Khan RA, Griffin PM, Haque MM. Unpacking Prevalence and Dichotomy in Quick Sequential Organ Failure Assessment and Systemic Inflammatory Response Syndrome Parameters: Observational Data-Driven Approach Backed by Sepsis Pathophysiology. JMIR Med Inform 2020; 8:e18352. [PMID: 33270030 PMCID: PMC7746497 DOI: 10.2196/18352] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2020] [Revised: 08/10/2020] [Accepted: 09/15/2020] [Indexed: 12/29/2022] Open
Abstract
BACKGROUND Considering morbidity, mortality, and annual treatment costs, the dramatic rise in the incidence of sepsis and septic shock among intensive care unit (ICU) admissions in US hospitals is an increasing concern. Recent changes in the sepsis definition (sepsis-3), based on the quick Sequential Organ Failure Assessment (qSOFA), have motivated the international medical informatics research community to investigate score recalculation and information retrieval, and to study the intersection between sepsis-3 and the previous definition (sepsis-2) based on systemic inflammatory response syndrome (SIRS) parameters. OBJECTIVE The objective of this study was three-fold. First, we aimed to unpack the most prevalent criterion for sepsis (for both sepsis-3 and sepsis-2 predictors). Second, we intended to determine the most prevalent sepsis scenario in the ICU among 4 possible scenarios for qSOFA and 11 possible scenarios for SIRS. Third, we investigated the multicollinearity or dichotomy among qSOFA and SIRS predictors. METHODS This observational study was conducted according to the most recent update of Medical Information Mart for Intensive Care (MIMIC-III, Version 1.4), the critical care database developed by MIT. The qSOFA (sepsis-3) and SIRS (sepsis-2) parameters were analyzed for patients admitted to critical care units from 2001 to 2012 in Beth Israel Deaconess Medical Center (Boston, MA, USA) to determine the prevalence and underlying relation between these parameters among patients undergoing sepsis screening. We adopted a multiblind Delphi method to seek a rationale for decisions in several stages of the research design regarding handling missing data and outlier values, statistical imputations and biases, and generalizability of the study. RESULTS Altered mental status in the Glasgow Coma Scale (59.28%, 38,854/65,545 observations) was the most prevalent sepsis-3 (qSOFA) criterion and the white blood cell count (53.12%, 17,163/32,311 observations) was the most prevalent sepsis-2 (SIRS) criterion confronted in the ICU. In addition, the two-factored sepsis criterion of high respiratory rate (≥22 breaths/minute) and altered mental status (28.19%, among four possible qSOFA scenarios besides no sepsis) was the most prevalent sepsis-3 (qSOFA) scenario, and the three-factored sepsis criterion of tachypnea, high heart rate, and high white blood cell count (12.32%, among 11 possible scenarios besides no sepsis) was the most prevalent sepsis-2 (SIRS) scenario in the ICU. Moreover, the absolute Pearson correlation coefficients were not significant, thereby nullifying the likelihood of any linear correlation among the critical parameters and assuring the lack of multicollinearity between the parameters. Although this further bolsters evidence for their dichotomy, the absence of multicollinearity cannot guarantee that two random variables are statistically independent. CONCLUSIONS Quantifying the prevalence of the qSOFA criteria of sepsis-3 in comparison with the SIRS criteria of sepsis-2, and understanding the underlying dichotomy among these parameters provides significant inferences for sepsis treatment initiatives in the ICU and informing hospital resource allocation. These data-driven results further offer design implications for multiparameter intelligent sepsis prediction in the ICU.
Collapse
Affiliation(s)
- Nazmus Sakib
- Ubicomp Lab, Department of Computer Science, Marquette University, Milwaukee, WI, United States
| | - Sheikh Iqbal Ahamed
- Ubicomp Lab, Department of Computer Science, Marquette University, Milwaukee, WI, United States
| | - Rumi Ahmed Khan
- College of Medicine, University of Central Florida, Orlando, FL, United States
| | - Paul M Griffin
- Regenstrief Center for Healthcare Engineering, Purdue University, West Lafayette, IN, United States
| | - Md Munirul Haque
- RB Annis School of Engineering, University of Indianapolis, Indianapolis, IN, United States
| |
Collapse
|
23
|
Bacchi S, Tan Y, Oakden-Rayner L, Jannes J, Kleinig T, Koblar S. Machine Learning in the Prediction of Medical Inpatient Length of Stay. Intern Med J 2020; 52:176-185. [PMID: 33094899 DOI: 10.1111/imj.14962] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2019] [Revised: 05/30/2020] [Accepted: 06/16/2020] [Indexed: 11/30/2022]
Abstract
BACKGROUND Length of stay (LOS) estimates are important for patients, doctors and hospital administrators. However, making accurate estimates of LOS can be difficult for medical patients. AIMS This review was conducted with the aim of identifying and assessing previous studies on the application of machine learning to the prediction of total hospital inpatient LOS for medical patients. METHODS A review of machine learning in the prediction of total hospital LOS for medical inpatients was conducted using the databases PubMed, EMBASE and Web of Science. RESULTS Of the 673 publications returned by the initial search, 21 articles met inclusion criteria. Of these articles the most commonly represented medical specialty was cardiology. Studies were also identified that had specifically evaluated machine learning LOS prediction in patients with diabetes and tuberculosis. The performance of the machine learning models in the identified studies varied significantly depending on factors including differing input datasets and different LOS thresholds and outcome metrics. Common methodological shortcomings included a lack of reporting of patient demographics and lack of reporting of clinical details of included patients. CONCLUSIONS The variable performance reported by the studies identified in this review supports the need for further research of the utility of machine learning in the prediction of total inpatient LOS in medical patients. Future studies should follow and report a more standardised methodology to better assess performance and to allow replication and validation. In particular, prospective validation studies and studies assessing the clinical impact of such machine learning models would be beneficial. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Stephen Bacchi
- Royal Adelaide Hospital, Adelaide, South Australia, 5000, Australia.,University of Adelaide, Adelaide, South Australia, 5005, Australia
| | - Yiran Tan
- Royal Adelaide Hospital, Adelaide, South Australia, 5000, Australia.,University of Adelaide, Adelaide, South Australia, 5005, Australia
| | - Luke Oakden-Rayner
- Royal Adelaide Hospital, Adelaide, South Australia, 5000, Australia.,University of Adelaide, Adelaide, South Australia, 5005, Australia
| | - Jim Jannes
- Royal Adelaide Hospital, Adelaide, South Australia, 5000, Australia.,University of Adelaide, Adelaide, South Australia, 5005, Australia
| | - Timothy Kleinig
- Royal Adelaide Hospital, Adelaide, South Australia, 5000, Australia.,University of Adelaide, Adelaide, South Australia, 5005, Australia
| | - Simon Koblar
- Royal Adelaide Hospital, Adelaide, South Australia, 5000, Australia.,University of Adelaide, Adelaide, South Australia, 5005, Australia
| |
Collapse
|
24
|
Ocampo-Quintero N, Vidal-Cortés P, Del Río Carbajo L, Fdez-Riverola F, Reboiro-Jato M, Glez-Peña D. Enhancing sepsis management through machine learning techniques: A review. Med Intensiva 2020; 46:S0210-5691(20)30102-9. [PMID: 32482370 DOI: 10.1016/j.medin.2020.04.003] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2019] [Revised: 03/27/2020] [Accepted: 04/05/2020] [Indexed: 12/11/2022]
Abstract
Sepsis is a major public health problem and a leading cause of death in the world, where delay in the beginning of treatment, along with clinical guidelines non-adherence have been proved to be associated with higher mortality. Machine Learning is increasingly being adopted in developing innovative Clinical Decision Support Systems in many areas of medicine, showing a great potential for automatic prediction of diverse patient conditions, as well as assistance in clinical decision making. In this context, this work conducts a narrative review to provide an overview of how specific Machine Learning techniques can be used to improve sepsis management, discussing the main tasks addressed, the most popular methods and techniques, as well as the obtained results, in terms of both intelligent system accuracy and clinical outcomes improvement.
Collapse
Affiliation(s)
- N Ocampo-Quintero
- ESEI - Escuela Superior de Ingeniería Informática, Universidad de Vigo, Ourense, Spain
| | - P Vidal-Cortés
- Intensive Care Unit, Complexo Hospitalario Universitario de Ourense, Ourense, Spain
| | - L Del Río Carbajo
- Intensive Care Unit, Complexo Hospitalario Universitario de Ourense, Ourense, Spain
| | - F Fdez-Riverola
- ESEI - Escuela Superior de Ingeniería Informática, Universidad de Vigo, Ourense, Spain; CINBIO - Centro de Investigaciones Biomédicas, Universidad de Vigo, Vigo, Spain; SING Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, Spain
| | - M Reboiro-Jato
- ESEI - Escuela Superior de Ingeniería Informática, Universidad de Vigo, Ourense, Spain; CINBIO - Centro de Investigaciones Biomédicas, Universidad de Vigo, Vigo, Spain; SING Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, Spain
| | - D Glez-Peña
- ESEI - Escuela Superior de Ingeniería Informática, Universidad de Vigo, Ourense, Spain; CINBIO - Centro de Investigaciones Biomédicas, Universidad de Vigo, Vigo, Spain; SING Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, Spain.
| |
Collapse
|
25
|
Berger J, Valera E, Jankelow A, Garcia C, Akhand M, Heredia J, Ghonge T, Liu C, Font-Bartumeus V, Oshana G, Tiao J, Bashir R. Simultaneous electrical detection of IL-6 and PCT using a microfluidic biochip platform. Biomed Microdevices 2020; 22:36. [PMID: 32419087 DOI: 10.1007/s10544-020-00492-6] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
Sepsis, a life-threatening organ dysfunction caused by a dysregulated host response, leads the U.S in both mortality rate and cost of treatment. Sepsis treatment protocols currently rely on broad and non-specific parameters like heart and respiration rate, and temperature; however, studies show that biomarkers Interlukin-6 (IL-6) and Procalcitonin (PCT) correlate to sepsis progression and response to treatment. Prior work also suggests that using multi-parameter predictive analytics with biomarkers and clinical information can inform treatment to improve outcome. A point-of-care (POC) platform that provides information for multiple biomarkers can aid in the diagnosis and prognosis of potentially septic patients. Using impedance cytometry, microbead immunoassays, and biotin-streptavidin binding, we report a microfluidic POC system that correlates microbead capture to IL-6 and PCT concentrations. A multiplexed microbead immunoassay is developed and validated for simultaneous detection of both IL-6 and PCT from human plasma samples. Using the POC platform, we quantified plasma samples containing healthy, medium (~103pg/ml) and high (~105pg/ml) IL-6 and PCT concentrations with various levels of significance (P < 0.05-P < 0.00001) and validated the concept of this device as a POC platform for sepsis biomarkers.
Collapse
Affiliation(s)
- Jacob Berger
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 1102 Everitt Lab, MC 278, 1406 W. Green St, Urbana, IL, 61801, USA.,Holonyak Micro and Nanotechnology Lab, University of Illinois at Urbana-Champaign, 208 N. Wright St., Urbana, IL, 61801, USA.,Biomedical Research Center, Carle Foundation Hospital, 509 W University Ave., Urbana, IL, 61801, USA
| | - Enrique Valera
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 1102 Everitt Lab, MC 278, 1406 W. Green St, Urbana, IL, 61801, USA.,Holonyak Micro and Nanotechnology Lab, University of Illinois at Urbana-Champaign, 208 N. Wright St., Urbana, IL, 61801, USA.,Biomedical Research Center, Carle Foundation Hospital, 509 W University Ave., Urbana, IL, 61801, USA
| | - Aaron Jankelow
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 1102 Everitt Lab, MC 278, 1406 W. Green St, Urbana, IL, 61801, USA.,Holonyak Micro and Nanotechnology Lab, University of Illinois at Urbana-Champaign, 208 N. Wright St., Urbana, IL, 61801, USA.,Biomedical Research Center, Carle Foundation Hospital, 509 W University Ave., Urbana, IL, 61801, USA
| | - Carlos Garcia
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 1102 Everitt Lab, MC 278, 1406 W. Green St, Urbana, IL, 61801, USA.,Holonyak Micro and Nanotechnology Lab, University of Illinois at Urbana-Champaign, 208 N. Wright St., Urbana, IL, 61801, USA.,Biomedical Research Center, Carle Foundation Hospital, 509 W University Ave., Urbana, IL, 61801, USA
| | - Manik Akhand
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 1102 Everitt Lab, MC 278, 1406 W. Green St, Urbana, IL, 61801, USA.,Holonyak Micro and Nanotechnology Lab, University of Illinois at Urbana-Champaign, 208 N. Wright St., Urbana, IL, 61801, USA
| | - John Heredia
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 1102 Everitt Lab, MC 278, 1406 W. Green St, Urbana, IL, 61801, USA.,Holonyak Micro and Nanotechnology Lab, University of Illinois at Urbana-Champaign, 208 N. Wright St., Urbana, IL, 61801, USA
| | - Tanmay Ghonge
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 1102 Everitt Lab, MC 278, 1406 W. Green St, Urbana, IL, 61801, USA.,Holonyak Micro and Nanotechnology Lab, University of Illinois at Urbana-Champaign, 208 N. Wright St., Urbana, IL, 61801, USA.,Biomedical Research Center, Carle Foundation Hospital, 509 W University Ave., Urbana, IL, 61801, USA.,Illumina, San Diego, CA, USA
| | - Cynthia Liu
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 1102 Everitt Lab, MC 278, 1406 W. Green St, Urbana, IL, 61801, USA.,Holonyak Micro and Nanotechnology Lab, University of Illinois at Urbana-Champaign, 208 N. Wright St., Urbana, IL, 61801, USA
| | - Victor Font-Bartumeus
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 1102 Everitt Lab, MC 278, 1406 W. Green St, Urbana, IL, 61801, USA.,Holonyak Micro and Nanotechnology Lab, University of Illinois at Urbana-Champaign, 208 N. Wright St., Urbana, IL, 61801, USA
| | - Gina Oshana
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 1102 Everitt Lab, MC 278, 1406 W. Green St, Urbana, IL, 61801, USA.,Holonyak Micro and Nanotechnology Lab, University of Illinois at Urbana-Champaign, 208 N. Wright St., Urbana, IL, 61801, USA
| | - Justin Tiao
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 1102 Everitt Lab, MC 278, 1406 W. Green St, Urbana, IL, 61801, USA.,Holonyak Micro and Nanotechnology Lab, University of Illinois at Urbana-Champaign, 208 N. Wright St., Urbana, IL, 61801, USA
| | - Rashid Bashir
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 1102 Everitt Lab, MC 278, 1406 W. Green St, Urbana, IL, 61801, USA. .,Holonyak Micro and Nanotechnology Lab, University of Illinois at Urbana-Champaign, 208 N. Wright St., Urbana, IL, 61801, USA. .,Biomedical Research Center, Carle Foundation Hospital, 509 W University Ave., Urbana, IL, 61801, USA. .,Carle Illinois College of Medicine, 807 South Wright St., Urbana, IL, 61801, USA.
| |
Collapse
|
26
|
Bradley R, Tagkopoulos I, Kim M, Kokkinos Y, Panagiotakos T, Kennedy J, De Meyer G, Watson P, Elliott J. Predicting early risk of chronic kidney disease in cats using routine clinical laboratory tests and machine learning. J Vet Intern Med 2019; 33:2644-2656. [PMID: 31557361 PMCID: PMC6872623 DOI: 10.1111/jvim.15623] [Citation(s) in RCA: 23] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2019] [Accepted: 08/29/2019] [Indexed: 02/01/2023] Open
Abstract
Background Advanced machine learning methods combined with large sets of health screening data provide opportunities for diagnostic value in human and veterinary medicine. Hypothesis/Objectives To derive a model to predict the risk of cats developing chronic kidney disease (CKD) using data from electronic health records (EHRs) collected during routine veterinary practice. Animals A total of 106 251 cats that attended Banfield Pet Hospitals between January 1, 1995, and December 31, 2017. Methods Longitudinal EHRs from Banfield Pet Hospitals were extracted and randomly split into 2 parts. The first 67% of the data were used to build a prediction model, which included feature selection and identification of the optimal neural network type and architecture. The remaining unseen EHRs were used to evaluate the model performance. Results The final model was a recurrent neural network (RNN) with 4 features (creatinine, blood urea nitrogen, urine specific gravity, and age). When predicting CKD near the point of diagnosis, the model displayed a sensitivity of 90.7% and a specificity of 98.9%. Model sensitivity decreased when predicting the risk of CKD with a longer horizon, having 63.0% sensitivity 1 year before diagnosis and 44.2% 2 years before diagnosis, but with specificity remaining around 99%. Conclusions and clinical importance The use of models based on machine learning can support veterinary decision making by improving early identification of CKD.
Collapse
Affiliation(s)
- Richard Bradley
- WALTHAM® Centre for Pet Nutrition, Freeby Lane, Waltham on the Wolds, Leicestershire, United Kingdom
| | - Ilias Tagkopoulos
- Department of Computer Science and Genome Center, University of California, Davis, California.,Process Integration and Predictive Analytics, PIPA LLC, Davis, California
| | - Minseung Kim
- Process Integration and Predictive Analytics, PIPA LLC, Davis, California
| | - Yiannis Kokkinos
- Process Integration and Predictive Analytics, PIPA LLC, Davis, California
| | | | | | - Geert De Meyer
- WALTHAM® Centre for Pet Nutrition, Freeby Lane, Waltham on the Wolds, Leicestershire, United Kingdom
| | - Phillip Watson
- WALTHAM® Centre for Pet Nutrition, Freeby Lane, Waltham on the Wolds, Leicestershire, United Kingdom
| | - Jonathan Elliott
- Department of Comparative Biomedical Sciences, Royal Veterinary College, London, United Kingdom
| |
Collapse
|
27
|
Peiffer-Smadja N, Rawson TM, Ahmad R, Buchard A, Georgiou P, Lescure FX, Birgand G, Holmes AH. Machine learning for clinical decision support in infectious diseases: a narrative review of current applications. Clin Microbiol Infect 2019; 26:584-595. [PMID: 31539636 DOI: 10.1016/j.cmi.2019.09.009] [Citation(s) in RCA: 199] [Impact Index Per Article: 39.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2019] [Revised: 08/29/2019] [Accepted: 09/09/2019] [Indexed: 12/22/2022]
Abstract
BACKGROUND Machine learning (ML) is a growing field in medicine. This narrative review describes the current body of literature on ML for clinical decision support in infectious diseases (ID). OBJECTIVES We aim to inform clinicians about the use of ML for diagnosis, classification, outcome prediction and antimicrobial management in ID. SOURCES References for this review were identified through searches of MEDLINE/PubMed, EMBASE, Google Scholar, biorXiv, ACM Digital Library, arXiV and IEEE Xplore Digital Library up to July 2019. CONTENT We found 60 unique ML-clinical decision support systems (ML-CDSS) aiming to assist ID clinicians. Overall, 37 (62%) focused on bacterial infections, 10 (17%) on viral infections, nine (15%) on tuberculosis and four (7%) on any kind of infection. Among them, 20 (33%) addressed the diagnosis of infection, 18 (30%) the prediction, early detection or stratification of sepsis, 13 (22%) the prediction of treatment response, four (7%) the prediction of antibiotic resistance, three (5%) the choice of antibiotic regimen and two (3%) the choice of a combination antiretroviral therapy. The ML-CDSS were developed for intensive care units (n = 24, 40%), ID consultation (n = 15, 25%), medical or surgical wards (n = 13, 20%), emergency department (n = 4, 7%), primary care (n = 3, 5%) and antimicrobial stewardship (n = 1, 2%). Fifty-three ML-CDSS (88%) were developed using data from high-income countries and seven (12%) with data from low- and middle-income countries (LMIC). The evaluation of ML-CDSS was limited to measures of performance (e.g. sensitivity, specificity) for 57 ML-CDSS (95%) and included data in clinical practice for three (5%). IMPLICATIONS Considering comprehensive patient data from socioeconomically diverse healthcare settings, including primary care and LMICs, may improve the ability of ML-CDSS to suggest decisions adapted to various clinical contexts. Currents gaps identified in the evaluation of ML-CDSS must also be addressed in order to know the potential impact of such tools for clinicians and patients.
Collapse
Affiliation(s)
- N Peiffer-Smadja
- National Institute for Health Research Health Protection Research Unit in Healthcare Associated Infections and Antimicrobial Resistance, Imperial College London, London, UK; French Institute for Medical Research (Inserm), Infection Antimicrobials Modelling Evolution (IAME), UMR 1137, University Paris Diderot, Paris, France.
| | - T M Rawson
- National Institute for Health Research Health Protection Research Unit in Healthcare Associated Infections and Antimicrobial Resistance, Imperial College London, London, UK
| | - R Ahmad
- National Institute for Health Research Health Protection Research Unit in Healthcare Associated Infections and Antimicrobial Resistance, Imperial College London, London, UK
| | | | - P Georgiou
- Department of Electrical and Electronic Engineering, Imperial College, London, UK
| | - F-X Lescure
- French Institute for Medical Research (Inserm), Infection Antimicrobials Modelling Evolution (IAME), UMR 1137, University Paris Diderot, Paris, France; Infectious Diseases Department, Bichat-Claude Bernard Hospital, Assistance-Publique Hôpitaux de Paris, Paris, France
| | - G Birgand
- National Institute for Health Research Health Protection Research Unit in Healthcare Associated Infections and Antimicrobial Resistance, Imperial College London, London, UK
| | - A H Holmes
- National Institute for Health Research Health Protection Research Unit in Healthcare Associated Infections and Antimicrobial Resistance, Imperial College London, London, UK
| |
Collapse
|
28
|
Rittmann B, Stevens MP. Clinical Decision Support Systems and Their Role in Antibiotic Stewardship: a Systematic Review. Curr Infect Dis Rep 2019; 21:29. [PMID: 31342180 DOI: 10.1007/s11908-019-0683-8] [Citation(s) in RCA: 34] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/15/2023]
Abstract
PURPOSE OF REVIEW The purpose of this article is to perform a systematic review over the past 5 years on the role and effectiveness of clinical decision support systems (CDSSs) on antibiotic stewardship. RECENT FINDINGS CDDS interventions found a significant impact on multiple outcomes relevant to antibiotic stewardship. There are various types of CDSS implementations, both active and passive (provider initiated). Passive interventions were associated with more significant outcomes; however, both interventions appeared effective. In the reviewed literature, CDSSs were consistently associated with decreasing antibiotic consumption and narrowing the spectrum of antibiotic usage. Generally, guideline adherence was improved with CDSS, although this was not universal. The effect on other outcomes, such as mortality, Clostridiodes difficile infections, length of stay, and cost, inconsistently showed a significant difference. Overall, CDDS implementation has effectively decreased antibiotic consumption and improved guideline adherence across the various types of CDSS. Other positive outcomes were noted in certain settings, but were not universal. When creating a new intervention, it is important to identify the optimal structure and deployment of a CDSS for a specific setting.
Collapse
Affiliation(s)
- Barry Rittmann
- Virginia Commonwealth University Health Systems, Richmond, USA. .,, 825 Fairfax Avenue, 4th Floor, Norfolk, VA, 23507, USA.
| | | |
Collapse
|
29
|
Belard A, Buchman T, Dente CJ, Potter BK, Kirk A, Elster E. The Uniformed Services University's Surgical Critical Care Initiative (SC2i): Bringing Precision Medicine to the Critically Ill. Mil Med 2019; 183:487-495. [PMID: 29635571 DOI: 10.1093/milmed/usx164] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2017] [Accepted: 12/22/2017] [Indexed: 11/13/2022] Open
Abstract
Precision medicine endeavors to leverage all available medical data in pursuit of individualized diagnostic and therapeutic plans to improve patient outcomes in a cost-effective manner. Its promise in the field of critical care remains incompletely realized. The Department of Defense has a vested interest in advancing precision medicine for those sent into harm's way and specifically seeks means of individualizing care in the context of complex and highly dynamic combat clinical decision environments. Building on legacy research efforts conducted during the Afghanistan and Iraq conflicts, the Uniformed Service University (USU) launched the Surgical Critical Care Initiative (SC2i) in 2013 to develop clinical- and biomarker-driven Clinical Decision Support Systems (CDSS), with the goals of improving both patient-specific outcomes and resource utilization for conditions with a high risk of morbidity or mortality. Despite technical and regulatory challenges, this military-civilian partnership is beginning to deliver on the promise of personalized care, organizing and analyzing sizable, real-time medical data sets to support complex clinical decision-making across critical and surgical care disciplines. We present the SC2i experience as a generalizable template for the national integration of federal and non-federal research databanks to foster critical and surgical care precision medicine.
Collapse
Affiliation(s)
- Arnaud Belard
- Department of Surgery, Uniformed Services University of the Health Sciences & the Walter Reed National Military Medical Center, 4301 Jones Bridge Road & 4494 N Palmer Road, Bethesda MD 20889.,Surgical Critical Care Initiative (SC2i), 4301 Jones Bridge Road, Bethesda, MD 20889
| | - Timothy Buchman
- Surgical Critical Care Initiative (SC2i), 4301 Jones Bridge Road, Bethesda, MD 20889.,Department of Surgery, Emory University, 201 Downman Dr. NE, Atlanta, GA 30322
| | - Christopher J Dente
- Surgical Critical Care Initiative (SC2i), 4301 Jones Bridge Road, Bethesda, MD 20889.,Department of Surgery, Emory University, 201 Downman Dr. NE, Atlanta, GA 30322
| | - Benjamin K Potter
- Department of Surgery, Uniformed Services University of the Health Sciences & the Walter Reed National Military Medical Center, 4301 Jones Bridge Road & 4494 N Palmer Road, Bethesda MD 20889.,Surgical Critical Care Initiative (SC2i), 4301 Jones Bridge Road, Bethesda, MD 20889
| | - Allan Kirk
- Department of Surgery, Emory University, 201 Downman Dr. NE, Atlanta, GA 30322.,Department of Surgery, Duke University, DUMC 3710, Durham, NC 27710
| | - Eric Elster
- Department of Surgery, Uniformed Services University of the Health Sciences & the Walter Reed National Military Medical Center, 4301 Jones Bridge Road & 4494 N Palmer Road, Bethesda MD 20889.,Surgical Critical Care Initiative (SC2i), 4301 Jones Bridge Road, Bethesda, MD 20889
| |
Collapse
|
30
|
Beeksma M, Verberne S, van den Bosch A, Das E, Hendrickx I, Groenewoud S. Predicting life expectancy with a long short-term memory recurrent neural network using electronic medical records. BMC Med Inform Decis Mak 2019; 19:36. [PMID: 30819172 PMCID: PMC6394008 DOI: 10.1186/s12911-019-0775-2] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2018] [Accepted: 02/18/2019] [Indexed: 01/03/2023] Open
Abstract
BACKGROUND Life expectancy is one of the most important factors in end-of-life decision making. Good prognostication for example helps to determine the course of treatment and helps to anticipate the procurement of health care services and facilities, or more broadly: facilitates Advance Care Planning. Advance Care Planning improves the quality of the final phase of life by stimulating doctors to explore the preferences for end-of-life care with their patients, and people close to the patients. Physicians, however, tend to overestimate life expectancy, and miss the window of opportunity to initiate Advance Care Planning. This research tests the potential of using machine learning and natural language processing techniques for predicting life expectancy from electronic medical records. METHODS We approached the task of predicting life expectancy as a supervised machine learning task. We trained and tested a long short-term memory recurrent neural network on the medical records of deceased patients. We developed the model with a ten-fold cross-validation procedure, and evaluated its performance on a held-out set of test data. We compared the performance of a model which does not use text features (baseline model) to the performance of a model which uses features extracted from the free texts of the medical records (keyword model), and to doctors' performance on a similar task as described in scientific literature. RESULTS Both doctors and the baseline model were correct in 20% of the cases, taking a margin of 33% around the actual life expectancy as the target. The keyword model, in comparison, attained an accuracy of 29% with its prognoses. While doctors overestimated life expectancy in 63% of the incorrect prognoses, which harms anticipation to appropriate end-of-life care, the keyword model overestimated life expectancy in only 31% of the incorrect prognoses. CONCLUSIONS Prognostication of life expectancy is difficult for humans. Our research shows that machine learning and natural language processing techniques offer a feasible and promising approach to predicting life expectancy. The research has potential for real-life applications, such as supporting timely recognition of the right moment to start Advance Care Planning.
Collapse
Affiliation(s)
- Merijn Beeksma
- Centre for Language Studies, Radboud University, Erasmusplein 1, 6525 HT Nijmegen, The Netherlands
| | - Suzan Verberne
- Leiden Institute for Advanced Computer Sciences, Leiden University, Niels Bohrweg 1, 2333 CA Leiden, The Netherlands
| | - Antal van den Bosch
- KNAW Meertens Institute, Oudezijds Achterburgwal 185, 1012 DK Amsterdam, The Netherlands
| | - Enny Das
- Centre for Language Studies, Radboud University, Erasmusplein 1, 6525 HT Nijmegen, The Netherlands
| | - Iris Hendrickx
- Centre for Language Studies, Radboud University, Erasmusplein 1, 6525 HT Nijmegen, The Netherlands
| | - Stef Groenewoud
- IQ Healthcare, Radboudumc, Mailbox 9101, 6500 HB Nijmegen, The Netherlands
| |
Collapse
|
31
|
Ruminski CM, Clark MT, Lake DE, Kitzmiller RR, Keim-Malpass J, Robertson MP, Simons TR, Moorman JR, Calland JF. Impact of predictive analytics based on continuous cardiorespiratory monitoring in a surgical and trauma intensive care unit. J Clin Monit Comput 2018; 33:703-711. [PMID: 30121744 DOI: 10.1007/s10877-018-0194-4] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2018] [Accepted: 08/02/2018] [Indexed: 01/10/2023]
Abstract
Predictive analytics monitoring, the use of patient data to provide continuous risk estimation of deterioration, is a promising new application of big data analytical techniques to the care of individual patients. We tested the hypothesis that continuous display of novel electronic risk visualization of respiratory and cardiovascular events would impact intensive care unit (ICU) patient outcomes. In an adult tertiary care surgical trauma ICU, we displayed risk estimation visualizations on a large monitor, but in the medical ICU in the same institution we did not. The risk estimates were based solely on analysis of continuous cardiorespiratory monitoring. We examined 4275 individual patient records within a 7 month time period preceding and following data display. We determined cases of septic shock, emergency intubation, hemorrhage, and death to compare rates per patient care pre-and post-implementation. Following implementation, the incidence of septic shock fell by half (p < 0.01 in a multivariate model that included age and APACHE) in the surgical trauma ICU, where the data were continuously on display, but by only 10% (p = NS) in the control Medical ICU. There were no significant changes in the other outcomes. Display of a predictive analytics monitor based on continuous cardiorespiratory monitoring was followed by a reduction in the rate of septic shock, even when controlling for age and APACHE score.
Collapse
Affiliation(s)
- Caroline M Ruminski
- University of Virginia School of Medicine, P.O. Box 800158, Charlottesville, VA, 22908, USA
| | - Matthew T Clark
- Advanced Medical Predictive Devices, Diagnostics, Displays (AMP3D), Charlottesville, VA, USA
| | - Douglas E Lake
- University of Virginia School of Medicine, P.O. Box 800158, Charlottesville, VA, 22908, USA
| | | | | | | | | | - J Randall Moorman
- University of Virginia School of Medicine, P.O. Box 800158, Charlottesville, VA, 22908, USA.
| | - J Forrest Calland
- University of Virginia School of Medicine, P.O. Box 800158, Charlottesville, VA, 22908, USA
| |
Collapse
|
32
|
Nibbelink CW, Young JR, Carrington JM, Brewer BB. Informatics Solutions for Application of Decision-Making Skills. Crit Care Nurs Clin North Am 2018; 30:237-246. [PMID: 29724442 PMCID: PMC5941940 DOI: 10.1016/j.cnc.2018.02.006] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
Abstract
Critical care nurses practice in a challenging environment that requires responses to patients with complex, often unstable health conditions. The electronic health record, access to clinical data, and Clinical Decision Support Systems informed by data from clinical databases are informatics tools designed to work together to facilitate decision-making in nursing practice. The complex decision-making environment of critical care requires informatics tools that support nursing practice through integration of current evidence with clinical data. Recommendations include continuing efforts toward the development of clinical decision support tools based on patient data that include predictive models to support increased patient safety.
Collapse
Affiliation(s)
- Christine W Nibbelink
- Department of Biomedical Informatics, University of California, San Diego, 9500 Gilman Drive, La Jolla, CA 92093, USA.
| | - Janay R Young
- Special Immunology Associates, El Rio Community Health Center, 1701 West Saint Mary's Road # 160, Tucson, AZ 85745, USA
| | - Jane M Carrington
- University of Arizona, College of Nursing, 1305 North Martin, Tucson, AZ 85721, USA
| | - Barbara B Brewer
- University of Arizona, College of Nursing, 1305 North Martin, Tucson, AZ 85721, USA
| |
Collapse
|
33
|
Horiguchi H, Loftus TJ, Hawkins RB, Raymond SL, Stortz JA, Hollen MK, Weiss BP, Miller ES, Bihorac A, Larson SD, Mohr AM, Brakenridge SC, Tsujimoto H, Ueno H, Moore FA, Moldawer LL, Efron PA. Innate Immunity in the Persistent Inflammation, Immunosuppression, and Catabolism Syndrome and Its Implications for Therapy. Front Immunol 2018; 9:595. [PMID: 29670613 PMCID: PMC5893931 DOI: 10.3389/fimmu.2018.00595] [Citation(s) in RCA: 108] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2018] [Accepted: 03/09/2018] [Indexed: 12/12/2022] Open
Abstract
Clinical and technological advances promoting early hemorrhage control and physiologic resuscitation as well as early diagnosis and optimal treatment of sepsis have significantly decreased in-hospital mortality for many critically ill patient populations. However, a substantial proportion of severe trauma and sepsis survivors will develop protracted organ dysfunction termed chronic critical illness (CCI), defined as ≥14 days requiring intensive care unit (ICU) resources with ongoing organ dysfunction. A subset of CCI patients will develop the persistent inflammation, immunosuppression, and catabolism syndrome (PICS), and these individuals are predisposed to a poor quality of life and indolent death. We propose that CCI and PICS after trauma or sepsis are the result of an inappropriate bone marrow response characterized by the generation of dysfunctional myeloid populations at the expense of lympho- and erythropoiesis. This review describes similarities among CCI/PICS phenotypes in sepsis, cancer, and aging and reviews the role of aberrant myelopoiesis in the pathophysiology of CCI and PICS. In addition, we characterize pathogen recognition, the interface between innate and adaptive immune systems, and therapeutic approaches including immune modulators, gut microbiota support, and nutritional and exercise therapy. Finally, we discuss the future of diagnostic and prognostic approaches guided by machine and deep-learning models trained and validated on big data to identify patients for whom these approaches will yield the greatest benefits. A deeper understanding of the pathophysiology of CCI and PICS and continued investigation into novel therapies harbor the potential to improve the current dismal long-term outcomes for critically ill post-injury and post-infection patients.
Collapse
Affiliation(s)
- Hiroyuki Horiguchi
- Department of Surgery, University of Florida College of Medicine, Gainesville, FL, United States.,Department of Surgery, National Defense Medical College, Tokorozawa, Japan
| | - Tyler J Loftus
- Department of Surgery, University of Florida College of Medicine, Gainesville, FL, United States
| | - Russell B Hawkins
- Department of Surgery, University of Florida College of Medicine, Gainesville, FL, United States
| | - Steven L Raymond
- Department of Surgery, University of Florida College of Medicine, Gainesville, FL, United States
| | - Julie A Stortz
- Department of Surgery, University of Florida College of Medicine, Gainesville, FL, United States
| | - McKenzie K Hollen
- Department of Surgery, University of Florida College of Medicine, Gainesville, FL, United States
| | - Brett P Weiss
- Department of Surgery, University of Florida College of Medicine, Gainesville, FL, United States
| | - Elizabeth S Miller
- Department of Surgery, University of Florida College of Medicine, Gainesville, FL, United States
| | - Azra Bihorac
- Department of Medicine, University of Florida College of Medicine, Gainesville, FL, United States
| | - Shawn D Larson
- Department of Surgery, University of Florida College of Medicine, Gainesville, FL, United States
| | - Alicia M Mohr
- Department of Surgery, University of Florida College of Medicine, Gainesville, FL, United States
| | - Scott C Brakenridge
- Department of Surgery, University of Florida College of Medicine, Gainesville, FL, United States
| | - Hironori Tsujimoto
- Department of Surgery, National Defense Medical College, Tokorozawa, Japan
| | - Hideki Ueno
- Department of Surgery, National Defense Medical College, Tokorozawa, Japan
| | - Frederick A Moore
- Department of Surgery, University of Florida College of Medicine, Gainesville, FL, United States
| | - Lyle L Moldawer
- Department of Surgery, University of Florida College of Medicine, Gainesville, FL, United States
| | - Philip A Efron
- Department of Surgery, University of Florida College of Medicine, Gainesville, FL, United States
| | | |
Collapse
|
34
|
Kim M, Tagkopoulos I. Data integration and predictive modeling methods for multi-omics datasets. Mol Omics 2018; 14:8-25. [DOI: 10.1039/c7mo00051k] [Citation(s) in RCA: 56] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
We provide an overview of opportunities and challenges in multi-omics predictive analytics with particular emphasis on data integration and machine learning methods.
Collapse
Affiliation(s)
- Minseung Kim
- Department of Computer Science
- University of California
- Davis
- USA
- Genome Center
| | - Ilias Tagkopoulos
- Department of Computer Science
- University of California
- Davis
- USA
- Genome Center
| |
Collapse
|
35
|
Wellner B, Grand J, Canzone E, Coarr M, Brady PW, Simmons J, Kirkendall E, Dean N, Kleinman M, Sylvester P. Predicting Unplanned Transfers to the Intensive Care Unit: A Machine Learning Approach Leveraging Diverse Clinical Elements. JMIR Med Inform 2017; 5:e45. [PMID: 29167089 PMCID: PMC5719228 DOI: 10.2196/medinform.8680] [Citation(s) in RCA: 48] [Impact Index Per Article: 6.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2017] [Revised: 09/22/2017] [Accepted: 09/23/2017] [Indexed: 11/16/2022] Open
Abstract
Background Early warning scores aid in the detection of pediatric clinical deteriorations but include limited data inputs, rarely include data trends over time, and have limited validation. Objective Machine learning methods that make use of large numbers of predictor variables are now commonplace. This work examines how different types of predictor variables derived from the electronic health record affect the performance of predicting unplanned transfers to the intensive care unit (ICU) at three large children’s hospitals. Methods We trained separate models with data from three different institutions from 2011 through 2013 and evaluated models with 2014 data. Cases consisted of patients who transferred from the floor to the ICU and met one or more of 5 different priori defined criteria for suspected unplanned transfers. Controls were patients who were never transferred to the ICU. Predictor variables for the models were derived from vitals, labs, acuity scores, and nursing assessments. Classification models consisted of L1 and L2 regularized logistic regression and neural network models. We evaluated model performance over prediction horizons ranging from 1 to 16 hours. Results Across the three institutions, the c-statistic values for our best models were 0.892 (95% CI 0.875-0.904), 0.902 (95% CI 0.880-0.923), and 0.899 (95% CI 0.879-0.919) for the task of identifying unplanned ICU transfer 6 hours before its occurrence and achieved 0.871 (95% CI 0.855-0.888), 0.872 (95% CI 0.850-0.895), and 0.850 (95% CI 0.825-0.875) for a prediction horizon of 16 hours. For our first model at 80% sensitivity, this resulted in a specificity of 80.5% (95% CI 77.4-83.7) and a positive predictive value of 5.2% (95% CI 4.5-6.2). Conclusions Feature-rich models with many predictor variables allow for patient deterioration to be predicted accurately, even up to 16 hours in advance.
Collapse
Affiliation(s)
- Ben Wellner
- The MITRE Corporation, Bedford, MA, United States
| | - Joan Grand
- The MITRE Corporation, Bedford, MA, United States
| | | | - Matt Coarr
- The MITRE Corporation, Bedford, MA, United States
| | - Patrick W Brady
- Cincinnati Children's Hospital, Cincinnati, OH, United States
| | - Jeffrey Simmons
- Cincinnati Children's Hospital, Cincinnati, OH, United States
| | - Eric Kirkendall
- Cincinnati Children's Hospital, Cincinnati, OH, United States
| | - Nathan Dean
- Children's National Health System, Washington, DC, United States
| | | | | |
Collapse
|
36
|
Combining Biomarkers with EMR Data to Identify Patients in Different Phases of Sepsis. Sci Rep 2017; 7:10800. [PMID: 28883645 PMCID: PMC5589821 DOI: 10.1038/s41598-017-09766-1] [Citation(s) in RCA: 47] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2017] [Accepted: 07/31/2017] [Indexed: 02/07/2023] Open
Abstract
Sepsis is a leading cause of death and is the most expensive condition to treat in U.S. hospitals. Despite targeted efforts to automate earlier detection of sepsis, current techniques rely exclusively on using either standard clinical data or novel biomarker measurements. In this study, we apply machine learning techniques to assess the predictive power of combining multiple biomarker measurements from a single blood sample with electronic medical record data (EMR) for the identification of patients in the early to peak phase of sepsis in a large community hospital setting. Combining biomarkers and EMR data achieved an area under the receiver operating characteristic (ROC) curve (AUC) of 0.81, while EMR data alone achieved an AUC of 0.75. Furthermore, a single measurement of six biomarkers (IL-6, nCD64, IL-1ra, PCT, MCP1, and G-CSF) yielded the same predictive power as collecting an additional 16 hours of EMR data(AUC of 0.80), suggesting that the biomarkers may be useful for identifying these patients earlier. Ultimately, supervised learning using a subset of biomarker and EMR data as features may be capable of identifying patients in the early to peak phase of sepsis in a diverse population and may provide a tool for more timely identification and intervention.
Collapse
|
37
|
Perner A, Gordon AC, Angus DC, Lamontagne F, Machado F, Russell JA, Timsit JF, Marshall JC, Myburgh J, Shankar-Hari M, Singer M. The intensive care medicine research agenda on septic shock. Intensive Care Med 2017; 43:1294-1305. [DOI: 10.1007/s00134-017-4821-1] [Citation(s) in RCA: 51] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2016] [Accepted: 04/25/2017] [Indexed: 12/15/2022]
|
38
|
Horng S, Sontag DA, Halpern Y, Jernite Y, Shapiro NI, Nathanson LA. Creating an automated trigger for sepsis clinical decision support at emergency department triage using machine learning. PLoS One 2017; 12:e0174708. [PMID: 28384212 PMCID: PMC5383046 DOI: 10.1371/journal.pone.0174708] [Citation(s) in RCA: 144] [Impact Index Per Article: 20.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2015] [Accepted: 03/14/2017] [Indexed: 01/17/2023] Open
Abstract
Objective To demonstrate the incremental benefit of using free text data in addition to vital sign and demographic data to identify patients with suspected infection in the emergency department. Methods This was a retrospective, observational cohort study performed at a tertiary academic teaching hospital. All consecutive ED patient visits between 12/17/08 and 2/17/13 were included. No patients were excluded. The primary outcome measure was infection diagnosed in the emergency department defined as a patient having an infection related ED ICD-9-CM discharge diagnosis. Patients were randomly allocated to train (64%), validate (20%), and test (16%) data sets. After preprocessing the free text using bigram and negation detection, we built four models to predict infection, incrementally adding vital signs, chief complaint, and free text nursing assessment. We used two different methods to represent free text: a bag of words model and a topic model. We then used a support vector machine to build the prediction model. We calculated the area under the receiver operating characteristic curve to compare the discriminatory power of each model. Results A total of 230,936 patient visits were included in the study. Approximately 14% of patients had the primary outcome of diagnosed infection. The area under the ROC curve (AUC) for the vitals model, which used only vital signs and demographic data, was 0.67 for the training data set, 0.67 for the validation data set, and 0.67 (95% CI 0.65–0.69) for the test data set. The AUC for the chief complaint model which also included demographic and vital sign data was 0.84 for the training data set, 0.83 for the validation data set, and 0.83 (95% CI 0.81–0.84) for the test data set. The best performing methods made use of all of the free text. In particular, the AUC for the bag-of-words model was 0.89 for training data set, 0.86 for the validation data set, and 0.86 (95% CI 0.85–0.87) for the test data set. The AUC for the topic model was 0.86 for the training data set, 0.86 for the validation data set, and 0.85 (95% CI 0.84–0.86) for the test data set. Conclusion Compared to previous work that only used structured data such as vital signs and demographic information, utilizing free text drastically improves the discriminatory ability (increase in AUC from 0.67 to 0.86) of identifying infection.
Collapse
Affiliation(s)
- Steven Horng
- Department of Emergency Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, United States of America
| | - David A. Sontag
- Department of Electrical Engineering and Computer Science, Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America
- * E-mail:
| | - Yoni Halpern
- Google, Cambridge, Massachusetts, United States of America
| | - Yacine Jernite
- Department of Computer Science, Courant Institute of Mathematical Sciences, New York University, New York, New York, United States of America
| | - Nathan I. Shapiro
- Department of Emergency Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Larry A. Nathanson
- Department of Emergency Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, United States of America
| |
Collapse
|
39
|
Zhu H, Colgan J, Reddy M, Choe EK. Sharing Patient-Generated Data in Clinical Practices: An Interview Study. AMIA ... ANNUAL SYMPOSIUM PROCEEDINGS. AMIA SYMPOSIUM 2017; 2016:1303-1312. [PMID: 28269928 PMCID: PMC5333267] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Patients are tracking and generating an increasingly large volume of personal health data outside the clinic due to an explosion of wearable sensing and mobile health (mHealth) apps. The potential usefulness of these data is enormous as they can provide good measures of everyday behavior and lifestyle. However, how we can fully leverage patient-generated data (PGD) and integrate them in clinical practice is less clear. In this interview study, we aim to understand how patients and clinicians currently share patient-generated data in clinical care practice. From the study, we identified technical, social, and organizational challenges in sharing and fully leveraging patient-generated data in clinical practices. Our findings can provide researchers potential avenues for enablers and barriers in sharing patient-generated data in clinical settings.
Collapse
Affiliation(s)
- Haining Zhu
- Pennsylvania State University, University Park, PA
| | | | | | | |
Collapse
|
40
|
Precision diagnosis: a view of the clinical decision support systems (CDSS) landscape through the lens of critical care. J Clin Monit Comput 2016; 31:261-271. [DOI: 10.1007/s10877-016-9849-1] [Citation(s) in RCA: 42] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2015] [Accepted: 02/17/2016] [Indexed: 10/22/2022]
|
41
|
Khazaei H, McGregor C, Eklund JM, El-Khatib K. Real-Time and Retrospective Health-Analytics-as-a-Service: A Novel Framework. JMIR Med Inform 2015; 3:e36. [PMID: 26582268 PMCID: PMC4704962 DOI: 10.2196/medinform.4640] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2015] [Revised: 09/04/2015] [Accepted: 09/30/2015] [Indexed: 01/06/2023] Open
Abstract
BACKGROUND Analytics-as-a-service (AaaS) is one of the latest provisions emerging from the cloud services family. Utilizing this paradigm of computing in health informatics will benefit patients, care providers, and governments significantly. This work is a novel approach to realize health analytics as services in critical care units in particular. OBJECTIVE To design, implement, evaluate, and deploy an extendable big-data compatible framework for health-analytics-as-a-service that offers both real-time and retrospective analysis. METHODS We present a novel framework that can realize health data analytics-as-a-service. The framework is flexible and configurable for different scenarios by utilizing the latest technologies and best practices for data acquisition, transformation, storage, analytics, knowledge extraction, and visualization. We have instantiated the proposed method, through the Artemis project, that is, a customization of the framework for live monitoring and retrospective research on premature babies and ill term infants in neonatal intensive care units (NICUs). RESULTS We demonstrated the proposed framework in this paper for monitoring NICUs and refer to it as the Artemis-In-Cloud (Artemis-IC) project. A pilot of Artemis has been deployed in the SickKids hospital NICU. By infusing the output of this pilot set up to an analytical model, we predict important performance measures for the final deployment of Artemis-IC. This process can be carried out for other hospitals following the same steps with minimal effort. SickKids' NICU has 36 beds and can classify the patients generally into 5 different types including surgical and premature babies. The arrival rate is estimated as 4.5 patients per day, and the average length of stay was calculated as 16 days. Mean number of medical monitoring algorithms per patient is 9, which renders 311 live algorithms for the whole NICU running on the framework. The memory and computation power required for Artemis-IC to handle the SickKids NICU will be 32 GB and 16 CPU cores, respectively. The required amount of storage was estimated as 8.6 TB per year. There will always be 34.9 patients in SickKids NICU on average. Currently, 46% of patients cannot get admitted to SickKids NICU due to lack of resources. By increasing the capacity to 90 beds, all patients can be accommodated. For such a provisioning, Artemis-IC will need 16 TB of storage per year, 55 GB of memory, and 28 CPU cores. CONCLUSIONS Our contributions in this work relate to a cloud architecture for the analysis of physiological data for clinical decisions support for tertiary care use. We demonstrate how to size the equipment needed in the cloud for that architecture based on a very realistic assessment of the patient characteristics and the associated clinical decision support algorithms that would be required to run for those patients. We show the principle of how this could be performed and furthermore that it can be replicated for any critical care setting within a tertiary institution.
Collapse
Affiliation(s)
- Hamzeh Khazaei
- IBM, Canada Research and Development Center, Markham, Toronto, ON, Canada.
| | | | | | | |
Collapse
|
42
|
Celi LA, Marshall JD, Lai Y, Stone DJ. Disrupting Electronic Health Records Systems: The Next Generation. JMIR Med Inform 2015; 3:e34. [PMID: 26500106 PMCID: PMC4704959 DOI: 10.2196/medinform.4192] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2014] [Revised: 06/08/2015] [Accepted: 07/24/2015] [Indexed: 11/13/2022] Open
Abstract
The health care system suffers from both inefficient and ineffective use of data. Data are suboptimally displayed to users, undernetworked, underutilized, and wasted. Errors, inefficiencies, and increased costs occur on the basis of unavailable data in a system that does not coordinate the exchange of information, or adequately support its use. Clinicians' schedules are stretched to the limit and yet the system in which they work exerts little effort to streamline and support carefully engineered care processes. Information for decision-making is difficult to access in the context of hurried real-time workflows. This paper explores and addresses these issues to formulate an improved design for clinical workflow, information exchange, and decision making based on the use of electronic health records.
Collapse
Affiliation(s)
- Leo Anthony Celi
- Beth Israel Deaconess Medical Center, Division of Pulmonary, Critical Care, and Sleep Medicine, Boston, MA, United States.
| | | | | | | |
Collapse
|
43
|
Automated Sepsis Detection, Alert, and Clinical Decision Support: Act on It or Silence the Alarm? Crit Care Med 2015; 43:1776-7. [PMID: 26181117 DOI: 10.1097/ccm.0000000000001099] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|