1
|
Li J, Li G, Liu Z, Yang X, Yang Q. Prediction models for the risk of ventilator-associated pneumonia in patients on mechanical ventilation: A systematic review and meta-analysis. Am J Infect Control 2024; 52:1438-1451. [PMID: 39025304 DOI: 10.1016/j.ajic.2024.07.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2024] [Revised: 07/10/2024] [Accepted: 07/11/2024] [Indexed: 07/20/2024]
Abstract
BACKGROUND Identifying patients at risk of ventilator-associated pneumonia through prediction models can facilitate medical decision-making. Our objective was to evaluate the current models for ventilator-associated pneumonia in patients with mechanical ventilation. METHODS Nine databases systematically retrieved from establishment to March 6, 2024. Two independent reviewers performed study selection, data extraction, and quality assessment, respectively. The Prediction Model Risk of Bias Assessment Tool was used to evaluate the risk of model bias and applicability. Stata 17.0 was used to conduct a meta-analysis of discrimination of model validation. RESULTS The total of 34 studies were included, with reported 52 prediction models. The most frequent predictors in the models were mechanical ventilation duration, length of intensive care unit stay, and age. Each study was essentially considered having a high risk of bias. A meta-analysis of 17 studies containing 33 models with validation was performed with a pooled area under the receiver-operating curve of 0.80 (95% confidence interval: 0.78-0.83). CONCLUSIONS Despite the relatively excellent performance of the models, there is a high risk of bias of the model development process. Enhancing the methodological quality, especially the external validation, practical application, and optimization of the models need urgent attention.
Collapse
Affiliation(s)
- Jiaying Li
- School of Nursing, Ningxia Medical University, Yinchuan, Ningxia, China
| | - Guifang Li
- Department of Critical Care Medicine, General Hospital of Ningxia Medical University, Yinchuan, Ningxia, China.
| | - Ziqing Liu
- School of Nursing, Ningxia Medical University, Yinchuan, Ningxia, China
| | - Xingyu Yang
- School of Nursing, Ningxia Medical University, Yinchuan, Ningxia, China
| | - Qiuyan Yang
- School of Nursing, Ningxia Medical University, Yinchuan, Ningxia, China
| |
Collapse
|
2
|
Giacobbe DR, Marelli C, Guastavino S, Signori A, Mora S, Rosso N, Campi C, Piana M, Murgia Y, Giacomini M, Bassetti M. Artificial intelligence and prescription of antibiotic therapy: present and future. Expert Rev Anti Infect Ther 2024; 22:819-833. [PMID: 39155449 DOI: 10.1080/14787210.2024.2386669] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2024] [Accepted: 07/28/2024] [Indexed: 08/20/2024]
Abstract
INTRODUCTION In the past few years, the use of artificial intelligence in healthcare has grown exponentially. Prescription of antibiotics is not exempt from its rapid diffusion, and various machine learning (ML) techniques, from logistic regression to deep neural networks and large language models, have been explored in the literature to support decisions regarding antibiotic prescription. AREAS COVERED In this narrative review, we discuss promises and challenges of the application of ML-based clinical decision support systems (ML-CDSSs) for antibiotic prescription. A search was conducted in PubMed up to April 2024. EXPERT OPINION Prescribing antibiotics is a complex process involving various dynamic phases. In each of these phases, the support of ML-CDSSs has shown the potential, and also the actual ability in some studies, to favorably impacting relevant clinical outcomes. Nonetheless, before widely exploiting this massive potential, there are still crucial challenges ahead that are being intensively investigated, pertaining to the transparency of training data, the definition of the sufficient degree of prediction explanations when predictions are obtained through black box models, and the legal and ethical framework for decision responsibility whenever an antibiotic prescription is supported by ML-CDSSs.
Collapse
Affiliation(s)
- Daniele Roberto Giacobbe
- Department of Health Sciences (DISSAL), University of Genoa, Genoa, Italy
- UO Clinica Malattie Infettive, IRCCS Ospedale Policlinico San Martino, Genoa, Italy
| | - Cristina Marelli
- UO Clinica Malattie Infettive, IRCCS Ospedale Policlinico San Martino, Genoa, Italy
| | | | - Alessio Signori
- Section of Biostatistics, Department of Health Sciences (DISSAL), University of Genoa, Genoa, Italy
| | - Sara Mora
- UO Information and Communication Technologies, IRCCS Ospedale Policlinico San Martino, Genoa, Italy
| | - Nicola Rosso
- UO Information and Communication Technologies, IRCCS Ospedale Policlinico San Martino, Genoa, Italy
| | - Cristina Campi
- Department of Mathematics (DIMA), University of Genoa, Genoa, Italy
- Life Science Computational Laboratory (LISCOMP), IRCCS Ospedale Policlinico San Martino, Genoa, Italy
| | - Michele Piana
- Department of Mathematics (DIMA), University of Genoa, Genoa, Italy
- Life Science Computational Laboratory (LISCOMP), IRCCS Ospedale Policlinico San Martino, Genoa, Italy
| | - Ylenia Murgia
- Department of Informatics, Bioengineering, Robotics and System Engineering (DIBRIS), University of Genoa, Genoa, Italy
| | - Mauro Giacomini
- Department of Informatics, Bioengineering, Robotics and System Engineering (DIBRIS), University of Genoa, Genoa, Italy
| | - Matteo Bassetti
- Department of Health Sciences (DISSAL), University of Genoa, Genoa, Italy
- UO Clinica Malattie Infettive, IRCCS Ospedale Policlinico San Martino, Genoa, Italy
| |
Collapse
|
3
|
Martin FP, Goronflot T, Moyer JD, Huet O, Asehnoune K, Cinotti R, Gourraud PA, Roquilly A. Predictive Models of Long-Term Outcome in Patients with Moderate to Severe Traumatic Brain Injury are Biased Toward Mortality Prediction. Neurocrit Care 2024:10.1007/s12028-024-02082-3. [PMID: 39138720 DOI: 10.1007/s12028-024-02082-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Accepted: 07/26/2024] [Indexed: 08/15/2024]
Abstract
BACKGROUND The prognostication of long-term functional outcomes remains challenging in patients with traumatic brain injury (TBI). Our aim was to demonstrate that intensive care unit (ICU) variables are not efficient to predict 6-month functional outcome in survivors with moderate to severe TBI (msTBI) but are mostly associated with mortality, which leads to a mortality bias for models predicting a composite outcome of mortality and severe disability. METHODS We analyzed the data from the multicenter randomized controlled Continuous Hyperosmolar Therapy in Traumatic Brain-Injured Patients trial and developed predictive models using machine learning methods and baseline characteristics and predictors collected during ICU stay. We compared our models' predictions of 6-month binary Glasgow Outcome Scale extended (GOS-E) score in all patients with msTBI (unfavorable GOS-E 1-4 vs. favorable GOS-E 5-8) with mortality (GOS-E 1 vs. GOS-E 2-8) and binary functional outcome in survivors with msTBI (severe disability GOS-E 2-4 vs. moderate to no disability GOS-E 5-8). We investigated the link between ICU variables and long-term functional outcomes in survivors with msTBI using predictive modeling and factor analysis of mixed data and validated our hypotheses on the International Mission for Prognosis and Analysis of Clinical Trials in TBI (IMPACT) model. RESULTS Based on data from 370 patients with msTBI and classically used ICU variables, the prediction of the 6-month outcome in survivors was inefficient (mean area under the receiver operating characteristic 0.52). Using factor analysis of mixed data graph, we demonstrated that high-variance ICU variables were not associated with outcome in survivors with msTBI (p = 0.15 for dimension 1, p = 0.53 for dimension 2) but mostly with mortality (p < 0.001 for dimension 1), leading to a mortality bias for models predicting a composite outcome of mortality and severe disability. We finally identified this mortality bias in the IMPACT model. CONCLUSIONS We demonstrated using machine learning-based predictive models that classically used ICU variables are strongly associated with mortality but not with 6-month outcome in survivors with msTBI, leading to a mortality bias when predicting a composite outcome of mortality and severe disability.
Collapse
Affiliation(s)
- Florian P Martin
- Nantes Université, Institut National de la Santé et de la Recherche Médicale (INSERM), UMR 1064, Center for Research in Transplantation and Translational Immunology (CR2TI), 22 Boulevard Bénoni Goullin, 44200, Nantes, France.
- Department of Anesthesiology and Surgical Intensive Care Unit, Centre Hospitalier Universitaire (CHU) Nantes, Nantes, France.
| | - Thomas Goronflot
- CHU Nantes, Pôle Hospitalo-Universitaire 11: Santé Publique, Clinique Des Données, INSERM, Nantes Université, Nantes, France
| | - Jean D Moyer
- Department of Anesthesia and Critical Care, Départements Médico-Universitaires Parabol, Assistance Publique-Hôpitaux de Paris Nord, Beaujon Hospital, Paris, France
| | - Olivier Huet
- Anesthesia and Intensive Care Unit, CHU Brest, Brest, France
| | - Karim Asehnoune
- Nantes Université, Institut National de la Santé et de la Recherche Médicale (INSERM), UMR 1064, Center for Research in Transplantation and Translational Immunology (CR2TI), 22 Boulevard Bénoni Goullin, 44200, Nantes, France
- Department of Anesthesiology and Surgical Intensive Care Unit, Centre Hospitalier Universitaire (CHU) Nantes, Nantes, France
| | - Raphaël Cinotti
- Department of Anesthesiology and Surgical Intensive Care Unit, Centre Hospitalier Universitaire (CHU) Nantes, Nantes, France
- Methods in Patient-Centered Outcomes and Healthy Research (SPHERE), INSERM, UMR 1246, Nantes Université, Université de Tours, Nantes, France
| | - Pierre A Gourraud
- Nantes Université, Institut National de la Santé et de la Recherche Médicale (INSERM), UMR 1064, Center for Research in Transplantation and Translational Immunology (CR2TI), 22 Boulevard Bénoni Goullin, 44200, Nantes, France
- CHU Nantes, Pôle Hospitalo-Universitaire 11: Santé Publique, Clinique Des Données, INSERM, Nantes Université, Nantes, France
| | - Antoine Roquilly
- Nantes Université, Institut National de la Santé et de la Recherche Médicale (INSERM), UMR 1064, Center for Research in Transplantation and Translational Immunology (CR2TI), 22 Boulevard Bénoni Goullin, 44200, Nantes, France
- Department of Anesthesiology and Surgical Intensive Care Unit, Centre Hospitalier Universitaire (CHU) Nantes, Nantes, France
| |
Collapse
|
4
|
Baddal B, Taner F, Uzun Ozsahin D. Harnessing of Artificial Intelligence for the Diagnosis and Prevention of Hospital-Acquired Infections: A Systematic Review. Diagnostics (Basel) 2024; 14:484. [PMID: 38472956 DOI: 10.3390/diagnostics14050484] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2023] [Revised: 01/23/2024] [Accepted: 02/19/2024] [Indexed: 03/14/2024] Open
Abstract
Healthcare-associated infections (HAIs) are the most common adverse events in healthcare and constitute a major global public health concern. Surveillance represents the foundation for the effective prevention and control of HAIs, yet conventional surveillance is costly and labor intensive. Artificial intelligence (AI) and machine learning (ML) have the potential to support the development of HAI surveillance algorithms for the understanding of HAI risk factors, the improvement of patient risk stratification as well as the prediction and timely detection and prevention of infections. AI-supported systems have so far been explored for clinical laboratory testing and imaging diagnosis, antimicrobial resistance profiling, antibiotic discovery and prediction-based clinical decision support tools in terms of HAIs. This review aims to provide a comprehensive summary of the current literature on AI applications in the field of HAIs and discuss the future potentials of this emerging technology in infection practice. Following the PRISMA guidelines, this study examined the articles in databases including PubMed and Scopus until November 2023, which were screened based on the inclusion and exclusion criteria, resulting in 162 included articles. By elucidating the advancements in the field, we aim to highlight the potential applications of AI in the field, report related issues and shortcomings and discuss the future directions.
Collapse
Affiliation(s)
- Buket Baddal
- Department of Medical Microbiology and Clinical Microbiology, Faculty of Medicine, Near East University, North Cyprus, Mersin 10, 99138 Nicosia, Turkey
- DESAM Research Institute, Near East University, North Cyprus, Mersin 10, 99138 Nicosia, Turkey
| | - Ferdiye Taner
- Department of Medical Microbiology and Clinical Microbiology, Faculty of Medicine, Near East University, North Cyprus, Mersin 10, 99138 Nicosia, Turkey
- DESAM Research Institute, Near East University, North Cyprus, Mersin 10, 99138 Nicosia, Turkey
| | - Dilber Uzun Ozsahin
- Department of Medical Diagnostic Imaging, College of Health Science, University of Sharjah, Sharjah 27272, United Arab Emirates
- Research Institute for Medical and Health Sciences, University of Sharjah, Sharjah 27272, United Arab Emirates
- Operational Research Centre in Healthcare, Near East University, North Cyprus, Mersin 10, 99138 Nicosia, Turkey
| |
Collapse
|