1
|
Klén R, Huespe IA, Gregalio FA, Lalueza Blanco AL, Pedrera Jimenez M, Garcia Barrio N, Valdez PR, Mirofsky MA, Boietti B, Gómez-Huelgas R, Casas-Rojo JM, Antón-Santos JM, Pollan JA, Gómez-Varela D. Development and validation of COEWS (COVID-19 Early Warning Score) for hospitalized COVID-19 with laboratory features: A multicontinental retrospective study. eLife 2023; 12:e85618. [PMID: 37615346 PMCID: PMC10479961 DOI: 10.7554/elife.85618] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2023] [Accepted: 08/23/2023] [Indexed: 08/25/2023] Open
Abstract
Background The emergence of new SARS-CoV-2 variants with significant immune-evasiveness, the relaxation of measures for reducing the number of infections, the waning of immune protection (particularly in high-risk population groups), and the low uptake of new vaccine boosters, forecast new waves of hospitalizations and admission to intensive care units. There is an urgent need for easily implementable and clinically effective Early Warning Scores (EWSs) that can predict the risk of complications within the next 24-48 hr. Although EWSs have been used in the evaluation of COVID-19 patients, there are several clinical limitations to their use. Moreover, no models have been tested on geographically distinct populations or population groups with varying levels of immune protection. Methods We developed and validated COVID-19 Early Warning Score (COEWS), an EWS that is automatically calculated solely from laboratory parameters that are widely available and affordable. We benchmarked COEWS against the widely used NEWS2. We also evaluated the predictive performance of vaccinated and unvaccinated patients. Results The variables of the COEWS predictive model were selected based on their predictive coefficients and on the wide availability of these laboratory variables. The final model included complete blood count, blood glucose, and oxygen saturation features. To make COEWS more actionable in real clinical situations, we transformed the predictive coefficients of the COEWS model into individual scores for each selected feature. The global score serves as an easy-to-calculate measure indicating the risk of a patient developing the combined outcome of mechanical ventilation or death within the next 48 hr.The discrimination in the external validation cohort was 0.743 (95% confidence interval [CI]: 0.703-0.784) for the COEWS score performed with coefficients and 0.700 (95% CI: 0.654-0.745) for the COEWS performed with scores. The area under the receiver operating characteristic curve (AUROC) was similar in vaccinated and unvaccinated patients. Additionally, we observed that the AUROC of the NEWS2 was 0.677 (95% CI: 0.601-0.752) in vaccinated patients and 0.648 (95% CI: 0.608-0.689) in unvaccinated patients. Conclusions The COEWS score predicts death or MV within the next 48 hr based on routine and widely available laboratory measurements. The extensive external validation, its high performance, its ease of use, and its positive benchmark in comparison with the widely used NEWS2 position COEWS as a new reference tool for assisting clinical decisions and improving patient care in the upcoming pandemic waves. Funding University of Vienna.
Collapse
Affiliation(s)
- Riku Klén
- Turku PET Centre, University of Turku and Turku University HospitalTurkuFinland
| | - Ivan A Huespe
- Italian Hospital of Buenos AiresBuenos AiresArgentina
| | | | - Antonio Lalueza Lalueza Blanco
- 12 de Octubre University Hospital, Research Institute of Hospital 12 de Octubre (imas+12), Complutense UniversityMadridSpain
| | - Miguel Pedrera Jimenez
- 12 de Octubre University Hospital, Research Institute of Hospital 12 de Octubre (imas+12), Complutense UniversityMadridSpain
| | - Noelia Garcia Barrio
- 12 de Octubre University Hospital, Research Institute of Hospital 12 de Octubre (imas+12), Complutense UniversityMadridSpain
| | | | - Matias A Mirofsky
- Hospital Municipal de Agudos Dr Leónidas LuceroBahía BlancaArgentina
| | - Bruno Boietti
- Italian Hospital of Buenos AiresBuenos AiresArgentina
| | - Ricardo Gómez-Huelgas
- Regional University Hospital of Málaga, Biomedical Research Institute of Málaga (IBIMA), University of MalagaMálagaSpain
| | | | | | | | - David Gómez-Varela
- Division of Pharmacology & Toxicology, Department of Pharmaceutical Sciences, University of ViennaViennaAustria
| |
Collapse
|
2
|
Tan BW, Tan BW, Tan AL, Schriver ER, Gutiérrez-Sacristán A, Das P, Yuan W, Hutch MR, García Barrio N, Pedrera Jimenez M, Abu-el-rub N, Morris M, Moal B, Verdy G, Cho K, Ho YL, Patel LP, Dagliati A, Neuraz A, Klann JG, South AM, Visweswaran S, Hanauer DA, Maidlow SE, Liu M, Mowery DL, Batugo A, Makoudjou A, Tippmann P, Zöller D, Brat GA, Luo Y, Avillach P, Bellazzi R, Chiovato L, Malovini A, Tibollo V, Samayamuthu MJ, Serrano Balazote P, Xia Z, Loh NHW, Chiudinelli L, Bonzel CL, Hong C, Zhang HG, Weber GM, Kohane IS, Cai T, Omenn GS, Holmes JH, Ngiam KY. Long-term kidney function recovery and mortality after COVID-19-associated acute kidney injury: An international multi-centre observational cohort study. EClinicalMedicine 2023; 55:101724. [PMID: 36381999 PMCID: PMC9640184 DOI: 10.1016/j.eclinm.2022.101724] [Citation(s) in RCA: 20] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Revised: 10/12/2022] [Accepted: 10/12/2022] [Indexed: 11/09/2022] Open
Abstract
Background While acute kidney injury (AKI) is a common complication in COVID-19, data on post-AKI kidney function recovery and the clinical factors associated with poor kidney function recovery is lacking. Methods A retrospective multi-centre observational cohort study comprising 12,891 hospitalized patients aged 18 years or older with a diagnosis of SARS-CoV-2 infection confirmed by polymerase chain reaction from 1 January 2020 to 10 September 2020, and with at least one serum creatinine value 1-365 days prior to admission. Mortality and serum creatinine values were obtained up to 10 September 2021. Findings Advanced age (HR 2.77, 95%CI 2.53-3.04, p < 0.0001), severe COVID-19 (HR 2.91, 95%CI 2.03-4.17, p < 0.0001), severe AKI (KDIGO stage 3: HR 4.22, 95%CI 3.55-5.00, p < 0.0001), and ischemic heart disease (HR 1.26, 95%CI 1.14-1.39, p < 0.0001) were associated with worse mortality outcomes. AKI severity (KDIGO stage 3: HR 0.41, 95%CI 0.37-0.46, p < 0.0001) was associated with worse kidney function recovery, whereas remdesivir use (HR 1.34, 95%CI 1.17-1.54, p < 0.0001) was associated with better kidney function recovery. In a subset of patients without chronic kidney disease, advanced age (HR 1.38, 95%CI 1.20-1.58, p < 0.0001), male sex (HR 1.67, 95%CI 1.45-1.93, p < 0.0001), severe AKI (KDIGO stage 3: HR 11.68, 95%CI 9.80-13.91, p < 0.0001), and hypertension (HR 1.22, 95%CI 1.10-1.36, p = 0.0002) were associated with post-AKI kidney function impairment. Furthermore, patients with COVID-19-associated AKI had significant and persistent elevations of baseline serum creatinine 125% or more at 180 days (RR 1.49, 95%CI 1.32-1.67) and 365 days (RR 1.54, 95%CI 1.21-1.96) compared to COVID-19 patients with no AKI. Interpretation COVID-19-associated AKI was associated with higher mortality, and severe COVID-19-associated AKI was associated with worse long-term post-AKI kidney function recovery. Funding Authors are supported by various funders, with full details stated in the acknowledgement section.
Collapse
Affiliation(s)
- Byorn W.L. Tan
- Department of Medicine, National University Hospital, 1E Kent Ridge Road, NUHS Tower Block Level 10, Singapore 119228
| | - Bryce W.Q. Tan
- Department of Medicine, National University Hospital, 1E Kent Ridge Road, NUHS Tower Block Level 10, Singapore 119228
| | - Amelia L.M. Tan
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - Emily R. Schriver
- Data Analytics Center, University of Pennsylvania Health System, 3600 Civic Center Boulevard, Philadelphia, PA 19104, USA
| | - Alba Gutiérrez-Sacristán
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - Priyam Das
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - William Yuan
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - Meghan R. Hutch
- Department of Preventive Medicine, Northwestern University, 750 North Lake Shore Drive, Chicago, IL 60611, USA
| | - Noelia García Barrio
- Department of Health Informatics, Hospital Universitario 12 de Octubre, Av. de Córdoba, s/n 28041 Madrid, Spain
| | - Miguel Pedrera Jimenez
- Department of Health Informatics, Hospital Universitario 12 de Octubre, Av. de Córdoba, s/n 28041 Madrid, Spain
| | - Noor Abu-el-rub
- Department of Internal Medicine, Division of Medical Informatics, University of Kansas Medical Center, 3901 Rainbow Blvd, Kansas City, KS 66160, USA
| | - Michele Morris
- Department of Biomedical Informatics, University of Pittsburgh, 5607 Baum Blvd, Pittsburgh, PA 15206, USA
| | - Bertrand Moal
- IAM Unit, Bordeaux University Hospital, Place Amélie Rabat Léon, 33076 Bordeaux, France
| | - Guillaume Verdy
- IAM Unit, Bordeaux University Hospital, Place Amélie Rabat Léon, 33076 Bordeaux, France
| | - Kelly Cho
- Massachusetts Veterans Epidemiology Research and Information Center, VA Boston Healthcare System, 2 Avenue De Lafayette, Boston, MA 02130, USA
| | - Yuk-Lam Ho
- Massachusetts Veterans Epidemiology Research and Information Center, VA Boston Healthcare System, 2 Avenue De Lafayette, Boston, MA 02130, USA
| | - Lav P. Patel
- Department of Internal Medicine, Division of Medical Informatics, University of Kansas Medical Center, 3901 Rainbow Blvd, Kansas City, KS 66160, USA
| | - Arianna Dagliati
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Italy, Via Ferrata 5, 27100 Pavia, Italy
| | - Antoine Neuraz
- Department of Biomedical Informatics, Hôpital Necker-Enfants Malade, Assistance Publique Hôpitaux de Paris, University of Paris, 149 Rue de Sèvres, 75015 Paris, France
| | - Jeffrey G. Klann
- Department of Medicine, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA
| | - Andrew M. South
- Department of Pediatrics-Section of Nephrology, Brenner Children's Hospital, Wake Forest School of Medicine, Medical Center Boulevard, Winston Salem, NC 27157, USA
| | - Shyam Visweswaran
- Department of Biomedical Informatics, University of Pittsburgh, 5607 Baum Blvd, Pittsburgh, PA 15206, USA
| | - David A. Hanauer
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, Michigan, USA, 100-107 NCRC, 2800 Plymouth Road, Ann Arbor, MI 48109, USA
| | - Sarah E. Maidlow
- Michigan Institute for Clinical and Health Research (MICHR) Informatics, University of Michigan, NCRC Bldg 400, 2800 Plymouth Road, Ann Arbor, MI, United States
| | - Mei Liu
- Department of Internal Medicine, Division of Medical Informatics, University of Kansas Medical Center, 3901 Rainbow Blvd, Kansas City, KS 66160, USA
| | - Danielle L. Mowery
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, 3700 Hamilton Walk, Richards Hall, A202, Philadelphia, PA 19104, USA
| | - Ashley Batugo
- Institute for Biomedical Informatics, University of Pennsylvania Perelman School of Medicine, 401 Blockley Hall 423 Guardian Drive Philadelphia, PA 19104, USA
| | - Adeline Makoudjou
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Zinkmattenstraße 6a, DE79108 Freiburg, Germany
| | - Patric Tippmann
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Zinkmattenstraße 6a, DE79108 Freiburg, Germany
| | - Daniela Zöller
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Zinkmattenstraße 6a, DE79108 Freiburg, Germany
| | - Gabriel A. Brat
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - Yuan Luo
- Department of Preventive Medicine, Northwestern University, 750 North Lake Shore Drive, Chicago, IL 60611, USA
| | - Paul Avillach
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - Riccardo Bellazzi
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Italy, Via Ferrata 5, 27100 Pavia, Italy
| | - Luca Chiovato
- Unit of Internal Medicine and Endocrinology, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Via Maugeri 4, 27100 Pavia, Italy
| | - Alberto Malovini
- Laboratory of Informatics and Systems Engineering for Clinical Research, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Italy., Via Maugeri 4, 27100 Pavia, Italy
| | - Valentina Tibollo
- Laboratory of Informatics and Systems Engineering for Clinical Research, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Italy., Via Maugeri 4, 27100 Pavia, Italy
| | | | - Pablo Serrano Balazote
- Department of Health Informatics, Hospital Universitario 12 de Octubre, Av. de Córdoba, s/n 28041 Madrid, Spain
| | - Zongqi Xia
- Department of Neurology, University of Pittsburgh, 3501 5th Avenue, BST-3 Suite 7014, Pittsburgh, PA 15260, USA
| | - Ne Hooi Will Loh
- Department of Anaesthesia, National University Health System, 5 Lower Kent Ridge Road, Singapore 119074
| | - Lorenzo Chiudinelli
- UOC Ricerca, Innovazione e Brand reputation, ASST Papa Giovanni XXIII, Bergamo, P.zza OMS 1 - 24127 Bergamo, Italy
| | - Clara-Lea Bonzel
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - Chuan Hong
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
- Department of Biostatistics and Bioinformatics, Duke University, 2424 Erwin Road, Durham, NC, United States
| | - Harrison G. Zhang
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - Griffin M. Weber
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - Isaac S. Kohane
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - Tianxi Cai
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - Gilbert S. Omenn
- Department of Computational Medicine & Bioinformatics, University of Michigan, 2017B Palmer Commons, 100 Washtenaw, Ann Arbor, MI 48109-2218
| | - John H. Holmes
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, 3700 Hamilton Walk, Richards Hall, A202, Philadelphia, PA 19104, USA
- Institute for Biomedical Informatics, University of Pennsylvania Perelman School of Medicine, 401 Blockley Hall 423 Guardian Drive Philadelphia, PA 19104, USA
| | - Kee Yuan Ngiam
- Department of Biomedical Informatics, WiSDM, National University Health Systems Singapore, 1E Kent Ridge Road, NUHS Tower Block Level 8, Singapore 119228
- Corresponding author. Department of Biomedical Informatics, WiSDM, National University Health Systems Singapore, 1E Kent Ridge Road, NUHS Tower Block Level 8, Singapore 119228.
| | | |
Collapse
|
3
|
Weber GM, Hong C, Palmer NP, Avillach P, Murphy SN, Gutiérrez-Sacristán A, Xia Z, Serret-Larmande A, Neuraz A, Omenn GS, Visweswaran S, Klann JG, South AM, Loh NHW, Cannataro M, Beaulieu-Jones BK, Bellazzi R, Agapito G, Alessiani M, Aronow BJ, Bell DS, Bellasi A, Benoit V, Beraghi M, Boeker M, Booth J, Bosari S, Bourgeois FT, Brown NW, Bucalo M, Chiovato L, Chiudinelli L, Dagliati A, Devkota B, DuVall SL, Follett RW, Ganslandt T, García Barrio N, Gradinger T, Griffier R, Hanauer DA, Holmes JH, Horki P, Huling KM, Issitt RW, Jouhet V, Keller MS, Kraska D, Liu M, Luo Y, Lynch KE, Malovini A, Mandl KD, Mao C, Maram A, Matheny ME, Maulhardt T, Mazzitelli M, Milano M, Moore JH, Morris JS, Morris M, Mowery DL, Naughton TP, Ngiam KY, Norman JB, Patel LP, Pedrera Jimenez M, Ramoni RB, Schriver ER, Scudeller L, Sebire NJ, Serrano Balazote P, Spiridou A, Tan AL, Tan BW, Tibollo V, Torti C, Trecarichi EM, Vitacca M, Zambelli A, Zucco C, Kohane IS, Cai T, Brat GA. International Comparisons of Harmonized Laboratory Value Trajectories to Predict Severe COVID-19: Leveraging the 4CE Collaborative Across 342 Hospitals and 6 Countries: A Retrospective Cohort Study. medRxiv 2021:2020.12.16.20247684. [PMID: 33564777 PMCID: PMC7872369 DOI: 10.1101/2020.12.16.20247684] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
Objectives To perform an international comparison of the trajectory of laboratory values among hospitalized patients with COVID-19 who develop severe disease and identify optimal timing of laboratory value collection to predict severity across hospitals and regions. Design Retrospective cohort study. Setting The Consortium for Clinical Characterization of COVID-19 by EHR (4CE), an international multi-site data-sharing collaborative of 342 hospitals in the US and in Europe. Participants Patients hospitalized with COVID-19, admitted before or after PCR-confirmed result for SARS-CoV-2. Primary and secondary outcome measures Patients were categorized as "ever-severe" or "never-severe" using the validated 4CE severity criteria. Eighteen laboratory tests associated with poor COVID-19-related outcomes were evaluated for predictive accuracy by area under the curve (AUC), compared between the severity categories. Subgroup analysis was performed to validate a subset of laboratory values as predictive of severity against a published algorithm. A subset of laboratory values (CRP, albumin, LDH, neutrophil count, D-dimer, and procalcitonin) was compared between North American and European sites for severity prediction. Results Of 36,447 patients with COVID-19, 19,953 (43.7%) were categorized as ever-severe. Most patients (78.7%) were 50 years of age or older and male (60.5%). Longitudinal trajectories of CRP, albumin, LDH, neutrophil count, D-dimer, and procalcitonin showed association with disease severity. Significant differences of laboratory values at admission were found between the two groups. With the exception of D-dimer, predictive discrimination of laboratory values did not improve after admission. Sub-group analysis using age, D-dimer, CRP, and lymphocyte count as predictive of severity at admission showed similar discrimination to a published algorithm (AUC=0.88 and 0.91, respectively). Both models deteriorated in predictive accuracy as the disease progressed. On average, no difference in severity prediction was found between North American and European sites. Conclusions Laboratory test values at admission can be used to predict severity in patients with COVID-19. Prediction models show consistency across international sites highlighting the potential generalizability of these models.
Collapse
Affiliation(s)
- Griffin M Weber
- Harvard Medical School, Department of Biomedical Informatics
| | - Chuan Hong
- Harvard Medical School, Department of Biomedical Informatics
| | - Nathan P Palmer
- Harvard Medical School, Department of Biomedical Informatics
| | - Paul Avillach
- Harvard Medical School, Department of Biomedical Informatics
| | | | | | | | - Arnaud Serret-Larmande
- Ho pital Européen Georges Pompidou, Assistance Publique - Ho pitaux de Paris, Department of biomedical informatics
| | | | - Gilbert S Omenn
- University of Michigan, Dept of Computational Medicine & Bioinformatics, Internal Medicine, Human Genetics, and School of Public Health
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - John Booth
- Great Ormond Street Hospital for Children
| | - Silvano Bosari
- Fondazione IRCCS Ca' Granda Ospedale Maggiore Policlinico
| | | | | | - Mauro Bucalo
- BIOMERIS (BIOMedical Research Informatics Solutions)
| | | | | | | | | | | | | | - Thomas Ganslandt
- Ruprecht Karls University Heidelberg Faculty of Medicine Mannheim
| | | | - Tobias Gradinger
- Ruprecht Karls University Heidelberg Faculty of Medicine Mannheim
| | | | - David A Hanauer
- University of Michigan Institute for Healthcare Policy & Innovation
| | - John H Holmes
- University of Pennsylvania Perelman School of Medicine
| | | | | | | | | | - Mark S Keller
- Harvard Medical School, Department of Biomedical Informatics
| | | | - Molei Liu
- Harvard University T H Chan School of Public Health
| | | | | | | | - Kenneth D Mandl
- Boston Children's Hospital, Computational Health Informatics Program
| | | | | | | | | | | | | | - Jason H Moore
- University of Pennsylvania Perelman School of Medicine
| | | | | | | | | | | | - James B Norman
- Harvard Medical School, Department of Biomedical Informatics
| | | | | | | | | | | | | | | | | | - Amelia Lm Tan
- Harvard Medical School, Department of Biomedical Informatics
| | | | | | | | | | | | | | | | - Isaac S Kohane
- Harvard Medical School, Department of Biomedical Informatics
| | - Tianxi Cai
- Harvard Medical School, Department of Biomedical Informatics
| | - Gabriel A Brat
- Beth Israel Deaconess Medical Center, Surgery
- Harvard Medical School, Department of Biomedical Informatics
| |
Collapse
|