1
|
Vagliano I, Chesnaye NC, Leopold JH, Jager KJ, Abu-Hanna A, Schut MC. Machine learning models for predicting acute kidney injury: a systematic review and critical appraisal. Clin Kidney J 2022; 15:2266-2280. [PMID: 36381375 PMCID: PMC9664575 DOI: 10.1093/ckj/sfac181] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2022] [Indexed: 09/08/2023] Open
Abstract
BACKGROUND The number of studies applying machine learning (ML) to predict acute kidney injury (AKI) has grown steadily over the past decade. We assess and critically appraise the state of the art in ML models for AKI prediction, considering performance, methodological soundness, and applicability. METHODS We searched PubMed and ArXiv, extracted data, and critically appraised studies based on the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD), Checklist for Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies (CHARMS), and Prediction Model Risk of Bias Assessment Tool (PROBAST) guidelines. RESULTS Forty-six studies from 3166 titles were included. Thirty-eight studies developed a model, five developed and externally validated one, and three studies externally validated one. Flexible ML methods were used more often than deep learning, although the latter was common with temporal variables and text as predictors. Predictive performance showed an area under receiver operating curves ranging from 0.49 to 0.99. Our critical appraisal identified a high risk of bias in 39 studies. Some studies lacked internal validation, whereas external validation and interpretability of results were rarely considered. Fifteen studies focused on AKI prediction in the intensive care setting, and the US-derived Medical Information Mart for Intensive Care (MIMIC) data set was commonly used. Reproducibility was limited as data and code were usually unavailable. CONCLUSIONS Flexible ML methods are popular for the prediction of AKI, although more complex models based on deep learning are emerging. Our critical appraisal identified a high risk of bias in most models: Studies should use calibration measures and external validation more often, improve model interpretability, and share data and code to improve reproducibility.
Collapse
Affiliation(s)
- Iacopo Vagliano
- Deptartment of Medical Informatics, Amsterdam UMC, University of Amsterdam, Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| | - Nicholas C Chesnaye
- ERA Registry, Department of Medical Informatics, Amsterdam UMC, University of Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| | - Jan Hendrik Leopold
- Deptartment of Medical Informatics, Amsterdam UMC, University of Amsterdam, Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| | - Kitty J Jager
- ERA Registry, Department of Medical Informatics, Amsterdam UMC, University of Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| | - Ameen Abu-Hanna
- Deptartment of Medical Informatics, Amsterdam UMC, University of Amsterdam, Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| | - Martijn C Schut
- Deptartment of Medical Informatics, Amsterdam UMC, University of Amsterdam, Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| |
Collapse
|
2
|
Zeng Z, Zou K, Qing C, Wang J, Tang Y. Predicting mortality in acute kidney injury patients undergoing continuous renal replacement therapy using a visualization model: A retrospective study. Front Physiol 2022; 13:964312. [PMID: 36425293 PMCID: PMC9679412 DOI: 10.3389/fphys.2022.964312] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2022] [Accepted: 10/20/2022] [Indexed: 11/29/2023] Open
Abstract
Background: Patients with severe acute kidney injury (AKI) require continuous renal replacement therapy (CRRT) when hemodynamically unstable. We aimed to identify prognostic factors and develop a nomogram that could predict mortality in patients with AKI undergoing CRRT. Methods: Data were extracted from the Dryad Digital Repository. We enrolled 1,002 participants and grouped them randomly into training (n = 670) and verification (n = 332) datasets based on a 2:1 proportion. Based on Cox proportional modeling of the training set, we created a web-based dynamic nomogram to estimate all-cause mortality. Results: The model incorporated phosphate, Charlson comorbidity index, body mass index, mean arterial pressure, levels of creatinine and albumin, and sequential organ failure assessment scores as independent predictive indicators. Model calibration and discrimination were satisfactory. In the training dataset, the area under the curves (AUCs) for estimating the 28-, 56-, and 84-day all-cause mortality were 0.779, 0.780, and 0.787, respectively. The model exhibited excellent calibration and discrimination in the validation dataset, with AUC values of 0.791, 0.778, and 0.806 for estimating 28-, 56-, and 84-day all-cause mortality, respectively. The calibration curves exhibited the consistency of the model between the two cohorts. To visualize the results, we created a web-based calculator. Conclusion: We created a web-based calculator for assessing fatality risk in patients with AKI receiving CRRT, which may help rationalize clinical decision-making and personalized therapy.
Collapse
Affiliation(s)
- Zhenguo Zeng
- Department of Critical Care Medicine, The First Affiliated Hospital of Nanchang University, Nanchang, China
| | - Kang Zou
- Department of Critical Care Medicine, The First Affiliated Hospital of Nanchang University, Nanchang, China
| | - Chen Qing
- Department of Critical Care Medicine, The First Affiliated Hospital of Nanchang University, Nanchang, China
| | - Jiao Wang
- Department of Endocrinology and Metabolism, The First Affiliated Hospital of Nanchang University, Nanchang, China
| | - Yunliang Tang
- Department of Rehabilitation Medicine, The First Affiliated Hospital of Nanchang University, Nanchang, China
| |
Collapse
|
3
|
Hong JC, Hauser ER, Redding TS, Sims KJ, Gellad ZF, O'Leary MC, Hyslop T, Madison AN, Qin X, Weiss D, Bullard AJ, Williams CD, Sullivan BA, Lieberman D, Provenzale D. Characterizing chronological accumulation of comorbidities in healthy veterans: a computational approach. Sci Rep 2021; 11:8104. [PMID: 33854078 PMCID: PMC8046765 DOI: 10.1038/s41598-021-85546-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2020] [Accepted: 12/14/2020] [Indexed: 12/13/2022] Open
Abstract
Understanding patient accumulation of comorbidities can facilitate healthcare strategy and personalized preventative care. We applied a directed network graph to electronic health record (EHR) data and characterized comorbidities in a cohort of healthy veterans undergoing screening colonoscopy. The Veterans Affairs Cooperative Studies Program #380 was a prospective longitudinal study of screening and surveillance colonoscopy. We identified initial instances of three-digit ICD-9 diagnoses for participants with at least 5 years of linked EHR history (October 1999 to December 2015). For diagnoses affecting at least 10% of patients, we calculated pairwise chronological relative risk (RR). iGraph was used to produce directed graphs of comorbidities with RR > 1, as well as summary statistics, key diseases, and communities. A directed graph based on 2210 patients visualized longitudinal development of comorbidities. Top hub (preceding) diseases included ischemic heart disease, inflammatory and toxic neuropathy, and diabetes. Top authority (subsequent) diagnoses were acute kidney failure and hypertensive chronic kidney failure. Four communities of correlated comorbidities were identified. Close analysis of top hub and authority diagnoses demonstrated known relationships, correlated sequelae, and novel hypotheses. Directed network graphs portray chronologic comorbidity relationships. We identified relationships between comorbid diagnoses in this aging veteran cohort. This may direct healthcare prioritization and personalized care.
Collapse
Affiliation(s)
- Julian C Hong
- Cooperative Studies Program Epidemiology Center-Durham, Durham VA Health Care System, Durham, NC, USA. .,Department of Radiation Oncology, University of California, San Francisco, San Francisco, CA, USA. .,Bakar Computational Health Sciences Institute, University of California, San Francisco, San Francisco, CA, USA.
| | - Elizabeth R Hauser
- Cooperative Studies Program Epidemiology Center-Durham, Durham VA Health Care System, Durham, NC, USA.,Department of Biostatistics and Bioinformatics, Duke University, Durham, NC, USA
| | - Thomas S Redding
- Cooperative Studies Program Epidemiology Center-Durham, Durham VA Health Care System, Durham, NC, USA
| | - Kellie J Sims
- Cooperative Studies Program Epidemiology Center-Durham, Durham VA Health Care System, Durham, NC, USA
| | - Ziad F Gellad
- Cooperative Studies Program Epidemiology Center-Durham, Durham VA Health Care System, Durham, NC, USA.,Department of Medicine, Duke University, Durham, NC, USA
| | - Meghan C O'Leary
- Cooperative Studies Program Epidemiology Center-Durham, Durham VA Health Care System, Durham, NC, USA
| | - Terry Hyslop
- Cooperative Studies Program Epidemiology Center-Durham, Durham VA Health Care System, Durham, NC, USA.,Department of Biostatistics and Bioinformatics, Duke University, Durham, NC, USA
| | - Ashton N Madison
- Cooperative Studies Program Epidemiology Center-Durham, Durham VA Health Care System, Durham, NC, USA
| | - Xuejun Qin
- Cooperative Studies Program Epidemiology Center-Durham, Durham VA Health Care System, Durham, NC, USA.,Department of Biostatistics and Bioinformatics, Duke University, Durham, NC, USA
| | - David Weiss
- Cooperative Studies Program Coordinating Center, Perry Point VA Medical Center, Perry Point, MD, USA
| | - A Jasmine Bullard
- Cooperative Studies Program Epidemiology Center-Durham, Durham VA Health Care System, Durham, NC, USA
| | - Christina D Williams
- Cooperative Studies Program Epidemiology Center-Durham, Durham VA Health Care System, Durham, NC, USA.,Department of Medicine, Duke University, Durham, NC, USA
| | - Brian A Sullivan
- Cooperative Studies Program Epidemiology Center-Durham, Durham VA Health Care System, Durham, NC, USA.,Department of Medicine, Duke University, Durham, NC, USA
| | - David Lieberman
- VA Portland Health Care System, Portland, OR, USA.,Oregon Health and Science University, Portland, OR, USA
| | - Dawn Provenzale
- Cooperative Studies Program Epidemiology Center-Durham, Durham VA Health Care System, Durham, NC, USA. .,Department of Medicine, Duke University, Durham, NC, USA.
| |
Collapse
|
4
|
Cabral M, Garçon G, Touré A, Bah F, Dewaele D, Bouhsina S, Cazier F, Faye A, Fall M, Courcot D, Verdin A. Renal impairment assessment on adults living nearby a landfill: Early kidney dysfunction biomarkers linked to the environmental exposure to heavy metals. Toxicol Rep 2021; 8:386-394. [PMID: 33717991 PMCID: PMC7932908 DOI: 10.1016/j.toxrep.2021.02.009] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2021] [Revised: 02/12/2021] [Accepted: 02/14/2021] [Indexed: 11/05/2022] Open
Abstract
Health risk of the neighboring population of the Mbeubeuss landfill (Senegal). Assessment of the impact of Cd/Pb exposure through dysfunction renal biomarkers. Specific increases of a set of early dysfunction renal biomarkers in exposed subjects. Glomerular and tubular dysfunction in exposed subjects.
The aim of this study was to assess the integrity and kidney overall functional capacity of subjects exposed to landfill emissions. Urine and blood levels of Pb and Cd, and several of the newly biomarkers of nephrotoxicity (Kim Injury Molecule 1 (KIM-1), alpha-1 Microglobulin (α1 M), beta-2 Microglobulin (β2 M), Cystatin-C (Cyst C), Clusterin, alpha-glutathione S-transferase (GSTα), pi-glutathione S-transferase (GSTπ), Tissue Inhibitor of Metalloproteinase-1 (TIMP1), Calbindin, Neutrophil Gelatinase-Associated Lipocalin (NGAL), Osteopontin (OPN), (Retinol Binding Protein(RBP), Liver-type Fatty Acid-Binding Protein (FABP-1), Trefoil Factor 3 (TFF3), Collagen VI) were measured in order to assess glomerular and tubule damage in adults living near a landfill. Our results indicate glomerular dysfunction in exposed subjects, and supported evidence of necrosis of proximal and distal tubule epithelial cells as specific biomarkers began to appear in the urine. Positive correlation by Pearson test were obtained between : blood Pb and B-OPN, B-Cyst C, Calbindin, U-KIM-1, TIMP1, U-OPN, and U-Clusterin; and also, between urinary Cd and TIMP1, B-Clusterin, U-OPN, FABP-1, Albumin, and U-Clusterin. The relation between biomarkers of Cd/Pb exposure and early effect biomarkers in this study clearly predicts the future risk of severe kidney injury in subjects living close to the landfill.
Collapse
Affiliation(s)
- Mathilde Cabral
- Univ. Littoral Côte d'Opale, UR 4492, UCEIV, Unité de Chimie Environnementale et Interactions sur le Vivant, SFR Condorcet FR CNRS 3417, F-59140, Dunkerque, France.,Laboratoire de Toxicologie et d'Hydrologie, Faculté de Médecine, de Pharmacie et d'Odontologie, Université Cheikh Anta Diop, Dakar, Senegal
| | - Guillaume Garçon
- Univ. Littoral Côte d'Opale, UR 4492, UCEIV, Unité de Chimie Environnementale et Interactions sur le Vivant, SFR Condorcet FR CNRS 3417, F-59140, Dunkerque, France.,CHU Lille, Institut Pasteur de Lille, ULR 4483-IMPacts de l'Environnement Chimique sur la Santé Humaine (IMPECS), Université Lille, Lille, France
| | - Aminata Touré
- Laboratoire de Toxicologie et d'Hydrologie, Faculté de Médecine, de Pharmacie et d'Odontologie, Université Cheikh Anta Diop, Dakar, Senegal
| | - Fatoumata Bah
- Laboratoire de Toxicologie et d'Hydrologie, Faculté de Médecine, de Pharmacie et d'Odontologie, Université Cheikh Anta Diop, Dakar, Senegal
| | - Dorothée Dewaele
- Univ. Littoral Côte d'Opale, CCM, Centre Commun de Mesures, F-59140, Dunkerque, France
| | - Saâd Bouhsina
- Univ. Littoral Côte d'Opale, UR 4492, UCEIV, Unité de Chimie Environnementale et Interactions sur le Vivant, SFR Condorcet FR CNRS 3417, F-59140, Dunkerque, France
| | - Fabrice Cazier
- Univ. Littoral Côte d'Opale, CCM, Centre Commun de Mesures, F-59140, Dunkerque, France
| | - Adama Faye
- Institut de Santé et Développement, Université Cheikh Anta Diop, Dakar, Senegal
| | - Mamadou Fall
- Laboratoire de Toxicologie et d'Hydrologie, Faculté de Médecine, de Pharmacie et d'Odontologie, Université Cheikh Anta Diop, Dakar, Senegal
| | - Dominique Courcot
- Univ. Littoral Côte d'Opale, UR 4492, UCEIV, Unité de Chimie Environnementale et Interactions sur le Vivant, SFR Condorcet FR CNRS 3417, F-59140, Dunkerque, France
| | - Anthony Verdin
- Univ. Littoral Côte d'Opale, UR 4492, UCEIV, Unité de Chimie Environnementale et Interactions sur le Vivant, SFR Condorcet FR CNRS 3417, F-59140, Dunkerque, France
| |
Collapse
|
5
|
Kashani K, Cheungpasitporn W, Ronco C. Biomarkers of acute kidney injury: the pathway from discovery to clinical adoption. Clin Chem Lab Med 2017; 55:1074-1089. [PMID: 28076311 DOI: 10.1515/cclm-2016-0973] [Citation(s) in RCA: 184] [Impact Index Per Article: 26.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2016] [Accepted: 10/31/2016] [Indexed: 12/11/2022]
Abstract
Acute kidney injury (AKI) is a common complication of critical illnesses and has a significant impact on outcomes, including mortality and morbidities. Unfortunately, apart from prophylactic measures, no effective treatment for this syndrome is known. Therefore, early recognition of AKI not only can provide better opportunities for preventive interventions, but also opens many gates for research and development of effective therapeutic options. Over the last few years, several new AKI biomarkers have been discovered and validated to improve early detection, differential diagnosis, and differentiation of patients into risk groups for progressive renal failure, need for renal replacement therapy (RRT), or death. These novel AKI biomarkers complement serum creatinine (SCr) and urine output, which are the standard diagnostic tools for AKI detection. In this article, we review the available literature on characteristics of promising AKI biomarkers that are currently the focus of preclinical and clinical investigations. These biomarkers include neutrophil gelatinase-associated lipocalin (NGAL), kidney injury molecule 1 (KIM-1), liver-type fatty acid-binding protein, interleukin 18 (lL-18), insulin-like growth factor-binding protein 7, tissue inhibitor of metalloproteinase 2 (TIMP-2), calprotectin, urine angiotensinogen (AGT), and urine microRNA. We then describe the clinical performance of these biomarkers for diagnosis and prognostication. We also appraise each AKI biomarker's advantages and limitations as a tool for early AKI recognition and prediction of clinical outcomes after AKI. Finally, we review the current and future states of implementation of biomarkers in the clinical practice.
Collapse
|