1
|
Wang X, Liu M, Nogues IE, Chen T, Xiong X, Bonzel CL, Zhang H, Hong C, Xia Y, Dahal K, Costa L, Cui J, Gaziano JM, Kim SC, Ho YL, Cho K, Cai T, Liao KP. Heterogeneous associations between interleukin-6 receptor variants and phenotypes across ancestries and implications for therapy. Sci Rep 2024; 14:8021. [PMID: 38580710 PMCID: PMC10997791 DOI: 10.1038/s41598-024-54063-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Accepted: 02/08/2024] [Indexed: 04/07/2024] Open
Abstract
The Phenome-Wide Association Study (PheWAS) is increasingly used to broadly screen for potential treatment effects, e.g., IL6R variant as a proxy for IL6R antagonists. This approach offers an opportunity to address the limited power in clinical trials to study differential treatment effects across patient subgroups. However, limited methods exist to efficiently test for differences across subgroups in the thousands of multiple comparisons generated as part of a PheWAS. In this study, we developed an approach that maximizes the power to test for heterogeneous genotype-phenotype associations and applied this approach to an IL6R PheWAS among individuals of African (AFR) and European (EUR) ancestries. We identified 29 traits with differences in IL6R variant-phenotype associations, including a lower risk of type 2 diabetes in AFR (OR 0.96) vs EUR (OR 1.0, p-value for heterogeneity = 8.5 × 10-3), and higher white blood cell count (p-value for heterogeneity = 8.5 × 10-131). These data suggest a more salutary effect of IL6R blockade for T2D among individuals of AFR vs EUR ancestry and provide data to inform ongoing clinical trials targeting IL6 for an expanding number of conditions. Moreover, the method to test for heterogeneity of associations can be applied broadly to other large-scale genotype-phenotype screens in diverse populations.
Collapse
Affiliation(s)
- Xuan Wang
- Department of Population Health Sciences, University of Utah, Salt Lake City, UT, USA
| | - Molei Liu
- Department of Biostatistics, Mailman School of Public Health, Columbia University, New York, NY, USA
| | | | - Tony Chen
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA, 02115, USA
| | - Xin Xiong
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA, 02115, USA
| | - Clara-Lea Bonzel
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA, 02115, USA
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Harrison Zhang
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
- Division of Rheumatology, Inflammation, and Immunity, Brigham and Women's Hospital, 60 Fenwood Road, Boston, MA, 02115, USA
| | - Chuan Hong
- Department of Biostatistics, Duke University, Durham, NC, USA
| | - Yin Xia
- Department of Statistics and Data Science, Fudan University, Shanghai, China
| | - Kumar Dahal
- Department of Biostatistics, Duke University, Durham, NC, USA
| | - Lauren Costa
- Massachusetts Veterans Epidemiology Research and Information Center, VA Boston Healthcare System, Boston, MA, USA
| | - Jing Cui
- Department of Biostatistics, Duke University, Durham, NC, USA
| | - J Michael Gaziano
- Massachusetts Veterans Epidemiology Research and Information Center, VA Boston Healthcare System, Boston, MA, USA
- Division of Aging, Brigham and Women's Hospital, Boston, MA, USA
| | - Seoyoung C Kim
- Division of Pharmacoepidemiology and Pharmacoeconomics, Brigham and Women's Hospital, Boston, MA, USA
| | - Yuk-Lam Ho
- Massachusetts Veterans Epidemiology Research and Information Center, VA Boston Healthcare System, Boston, MA, USA
| | - Kelly Cho
- Massachusetts Veterans Epidemiology Research and Information Center, VA Boston Healthcare System, Boston, MA, USA
- Division of Aging, Brigham and Women's Hospital, Boston, MA, USA
| | - Tianxi Cai
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA, 02115, USA.
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA.
| | - Katherine P Liao
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA.
- Division of Rheumatology, Inflammation, and Immunity, Brigham and Women's Hospital, 60 Fenwood Road, Boston, MA, 02115, USA.
- Massachusetts Veterans Epidemiology Research and Information Center, VA Boston Healthcare System, Boston, MA, USA.
- Rheumatology Section, VA Boston Healthcare System, Boston, USA.
| |
Collapse
|
2
|
Hutch MR, Son J, Le TT, Hong C, Wang X, Shakeri Hossein Abad Z, Morris M, Gutiérrez-Sacristán A, Klann JG, Spiridou A, Batugo A, Bellazzi R, Benoit V, Bonzel CL, Bryant WA, Chiudinelli L, Cho K, Das P, González González T, Hanauer DA, Henderson DW, Ho YL, Loh NHW, Makoudjou A, Makwana S, Malovini A, Moal B, Mowery DL, Neuraz A, Samayamuthu MJ, Sanz Vidorreta FJ, Schriver ER, Schubert P, Talbert J, Tan ALM, Tan BWL, Tan BWQ, Tibollo V, Tippman P, Verdy G, Yuan W, Avillach P, Gehlenborg N, Omenn GS, Visweswaran S, Cai T, Luo Y, Xia Z. Neurological diagnoses in hospitalized COVID-19 patients associated with adverse outcomes: A multinational cohort study. PLOS Digit Health 2024; 3:e0000484. [PMID: 38620037 PMCID: PMC11018281 DOI: 10.1371/journal.pdig.0000484] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Accepted: 03/06/2024] [Indexed: 04/17/2024]
Abstract
Few studies examining the patient outcomes of concurrent neurological manifestations during acute COVID-19 leveraged multinational cohorts of adults and children or distinguished between central and peripheral nervous system (CNS vs. PNS) involvement. Using a federated multinational network in which local clinicians and informatics experts curated the electronic health records data, we evaluated the risk of prolonged hospitalization and mortality in hospitalized COVID-19 patients from 21 healthcare systems across 7 countries. For adults, we used a federated learning approach whereby we ran Cox proportional hazard models locally at each healthcare system and performed a meta-analysis on the aggregated results to estimate the overall risk of adverse outcomes across our geographically diverse populations. For children, we reported descriptive statistics separately due to their low frequency of neurological involvement and poor outcomes. Among the 106,229 hospitalized COVID-19 patients (104,031 patients ≥18 years; 2,198 patients <18 years, January 2020-October 2021), 15,101 (14%) had at least one CNS diagnosis, while 2,788 (3%) had at least one PNS diagnosis. After controlling for demographics and pre-existing conditions, adults with CNS involvement had longer hospital stay (11 versus 6 days) and greater risk of (Hazard Ratio = 1.78) and faster time to death (12 versus 24 days) than patients with no neurological condition (NNC) during acute COVID-19 hospitalization. Adults with PNS involvement also had longer hospital stay but lower risk of mortality than the NNC group. Although children had a low frequency of neurological involvement during COVID-19 hospitalization, a substantially higher proportion of children with CNS involvement died compared to those with NNC (6% vs 1%). Overall, patients with concurrent CNS manifestation during acute COVID-19 hospitalization faced greater risks for adverse clinical outcomes than patients without any neurological diagnosis. Our global informatics framework using a federated approach (versus a centralized data collection approach) has utility for clinical discovery beyond COVID-19.
Collapse
Affiliation(s)
- Meghan R. Hutch
- Department of Preventive Medicine, Northwestern University, Chicago, Illinois, United States of America
| | - Jiyeon Son
- Department of Neurology, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America
| | - Trang T. Le
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, United States of America
| | - Chuan Hong
- Department of Biostatistics and Bioinformatics, Duke University, Durham, North Carolina, United States of America
- Department of Population Health Sciences, University of Utah, Salt Lake City, Utah, United States of America
| | - Xuan Wang
- Department of Population Health Sciences, University of Utah, Salt Lake City, Utah, United States of America
| | - Zahra Shakeri Hossein Abad
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Michele Morris
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America
| | - Alba Gutiérrez-Sacristán
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Jeffrey G. Klann
- Department of Medicine, Massachusetts General Hospital, Boston, Massachusetts, United States of America
| | - Anastasia Spiridou
- Digital Research, Informatics and Virtual Environments (DRIVE), Great Ormond Street Hospital for Children, London, United Kingdom
| | - Ashley Batugo
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, United States of America
| | - Riccardo Bellazzi
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Vincent Benoit
- IT Department, Innovation & Data, APHP Greater Paris University Hospital, Paris, France
| | - Clara-Lea Bonzel
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - William A. Bryant
- Digital Research, Informatics and Virtual Environments (DRIVE), Great Ormond Street Hospital for Children, London, United Kingdom
| | - Lorenzo Chiudinelli
- UOC Ricerca, Innovazione e Brand reputation, ASST Papa Giovanni XXIII, Bergamo, Italy
| | - Kelly Cho
- Population Health and Data Science, VA Boston Healthcare System, Boston Massachusetts, United States of America
- Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), VA Boston Healthcare System, Boston Massachusetts, United States of America
| | - Priyam Das
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | | | - David A. Hanauer
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, Michigan, United States of America
| | - Darren W. Henderson
- Center for Clinical and Translational Science, University of Kentucky, Lexington, Kentucky, United States of America
| | - Yuk-Lam Ho
- Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), VA Boston Healthcare System, Boston Massachusetts, United States of America
| | - Ne Hooi Will Loh
- Department of Anaesthesia, National University Health System, Kent Ridge, Singapore
| | - Adeline Makoudjou
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
| | - Simran Makwana
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Alberto Malovini
- Laboratory of Informatics and Systems Engineering for Clinical Research, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Italy
| | - Bertrand Moal
- IAM Unit, Bordeaux University Hospital, Bordeaux, France
| | - Danielle L. Mowery
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, United States of America
| | - Antoine Neuraz
- Department of biomedical informatics, Hôpital Necker-Enfants Malade, Assistance Publique Hôpitaux de Paris (APHP), University of Paris, Paris, France
| | | | - Fernando J. Sanz Vidorreta
- Department of Medicine, David Geffen School of Medicine at UCLA, Los Angeles, California, United States of America
| | - Emily R. Schriver
- Data Analytics Center, University of Pennsylvania Health System, Philadelphia, Pennsylvania, United States of America
| | - Petra Schubert
- Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), VA Boston Healthcare System, Boston Massachusetts, United States of America
| | - Jeffery Talbert
- Division of Biomedical Informatics, University of Kentucky, Lexington, Kentucky, United States of America
| | - Amelia L. M. Tan
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Byorn W. L. Tan
- Department of Medicine, National University Hospital, Singapore, Kent Ridge, Singapore
| | - Bryce W. Q. Tan
- Department of Medicine, National University Hospital, Singapore, Kent Ridge, Singapore
| | - Valentina Tibollo
- Laboratory of Informatics and Systems Engineering for Clinical Research, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Italy
| | - Patric Tippman
- Institute of Medical Biometry and University of Freiburg, Medical Center, Freiburg, Germany
| | | | - William Yuan
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Paul Avillach
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Nils Gehlenborg
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Gilbert S. Omenn
- Departments of Computational Medicine & Bioinformatics, Internal Medicine, Human Genetics, Public Health, University of Michigan, Ann Arbor, Michigan, United States of America
| | | | - Shyam Visweswaran
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America
| | - Tianxi Cai
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Yuan Luo
- Department of Preventive Medicine, Northwestern University, Chicago, Illinois, United States of America
| | - Zongqi Xia
- Department of Neurology, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America
| |
Collapse
|
3
|
Gao J, Bonzel CL, Hong C, Varghese P, Zakir K, Gronsbell J. Semi-supervised ROC analysis for reliable and streamlined evaluation of phenotyping algorithms. J Am Med Inform Assoc 2024; 31:640-650. [PMID: 38128118 PMCID: PMC10873838 DOI: 10.1093/jamia/ocad226] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Revised: 09/22/2023] [Accepted: 11/20/2023] [Indexed: 12/23/2023] Open
Abstract
OBJECTIVE High-throughput phenotyping will accelerate the use of electronic health records (EHRs) for translational research. A critical roadblock is the extensive medical supervision required for phenotyping algorithm (PA) estimation and evaluation. To address this challenge, numerous weakly-supervised learning methods have been proposed. However, there is a paucity of methods for reliably evaluating the predictive performance of PAs when a very small proportion of the data is labeled. To fill this gap, we introduce a semi-supervised approach (ssROC) for estimation of the receiver operating characteristic (ROC) parameters of PAs (eg, sensitivity, specificity). MATERIALS AND METHODS ssROC uses a small labeled dataset to nonparametrically impute missing labels. The imputations are then used for ROC parameter estimation to yield more precise estimates of PA performance relative to classical supervised ROC analysis (supROC) using only labeled data. We evaluated ssROC with synthetic, semi-synthetic, and EHR data from Mass General Brigham (MGB). RESULTS ssROC produced ROC parameter estimates with minimal bias and significantly lower variance than supROC in the simulated and semi-synthetic data. For the 5 PAs from MGB, the estimates from ssROC are 30% to 60% less variable than supROC on average. DISCUSSION ssROC enables precise evaluation of PA performance without demanding large volumes of labeled data. ssROC is also easily implementable in open-source R software. CONCLUSION When used in conjunction with weakly-supervised PAs, ssROC facilitates the reliable and streamlined phenotyping necessary for EHR-based research.
Collapse
Affiliation(s)
- Jianhui Gao
- Department of Statistical Sciences, University of Toronto, Toronto, ON, Canada
| | - Clara-Lea Bonzel
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Chuan Hong
- Department of Biostatistics and Bioinformatics, Duke University, Durham, NC, United States
| | - Paul Varghese
- Health Informatics, Verily Life Sciences, Cambridge, MA, United States
| | - Karim Zakir
- Department of Statistical Sciences, University of Toronto, Toronto, ON, Canada
| | - Jessica Gronsbell
- Department of Statistical Sciences, University of Toronto, Toronto, ON, Canada
- Department of Family and Community Medicine, University of Toronto, Toronto, ON, Canada
- Department of Computer Science, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
4
|
Wen J, Hou J, Bonzel CL, Zhao Y, Castro VM, Gainer VS, Weisenfeld D, Cai T, Ho YL, Panickan VA, Costa L, Hong C, Gaziano JM, Liao KP, Lu J, Cho K, Cai T. LATTE: Label-efficient incident phenotyping from longitudinal electronic health records. Patterns (N Y) 2024; 5:100906. [PMID: 38264714 PMCID: PMC10801250 DOI: 10.1016/j.patter.2023.100906] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Revised: 09/06/2023] [Accepted: 12/01/2023] [Indexed: 01/25/2024]
Abstract
Electronic health record (EHR) data are increasingly used to support real-world evidence studies but are limited by the lack of precise timings of clinical events. Here, we propose a label-efficient incident phenotyping (LATTE) algorithm to accurately annotate the timing of clinical events from longitudinal EHR data. By leveraging the pre-trained semantic embeddings, LATTE selects predictive features and compresses their information into longitudinal visit embeddings through visit attention learning. LATTE models the sequential dependency between the target event and visit embeddings to derive the timings. To improve label efficiency, LATTE constructs longitudinal silver-standard labels from unlabeled patients to perform semi-supervised training. LATTE is evaluated on the onset of type 2 diabetes, heart failure, and relapses of multiple sclerosis. LATTE consistently achieves substantial improvements over benchmark methods while providing high prediction interpretability. The event timings are shown to help discover risk factors of heart failure among patients with rheumatoid arthritis.
Collapse
Affiliation(s)
- Jun Wen
- Harvard Medical School, Boston, MA, USA
- VA Boston Healthcare System, Boston, MA, USA
| | - Jue Hou
- University of Minnesota, Minneapolis, MN, USA
| | - Clara-Lea Bonzel
- Harvard Medical School, Boston, MA, USA
- VA Boston Healthcare System, Boston, MA, USA
| | | | | | | | | | - Tianrun Cai
- VA Boston Healthcare System, Boston, MA, USA
- Mass General Brigham, Boston, MA, USA
| | - Yuk-Lam Ho
- VA Boston Healthcare System, Boston, MA, USA
| | - Vidul A. Panickan
- Harvard Medical School, Boston, MA, USA
- VA Boston Healthcare System, Boston, MA, USA
| | | | | | - J. Michael Gaziano
- Harvard Medical School, Boston, MA, USA
- VA Boston Healthcare System, Boston, MA, USA
- Brigham and Women’s Hospital, Boston, MA, USA
| | - Katherine P. Liao
- Harvard Medical School, Boston, MA, USA
- VA Boston Healthcare System, Boston, MA, USA
- Brigham and Women’s Hospital, Boston, MA, USA
| | - Junwei Lu
- VA Boston Healthcare System, Boston, MA, USA
- Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Kelly Cho
- Harvard Medical School, Boston, MA, USA
- VA Boston Healthcare System, Boston, MA, USA
- Brigham and Women’s Hospital, Boston, MA, USA
| | - Tianxi Cai
- Harvard Medical School, Boston, MA, USA
- VA Boston Healthcare System, Boston, MA, USA
- Harvard T.H. Chan School of Public Health, Boston, MA, USA
| |
Collapse
|
5
|
Xiong X, Sweet SM, Liu M, Hong C, Bonzel CL, Panickan VA, Zhou D, Wang L, Costa L, Ho YL, Geva A, Mandl KD, Cheng S, Xia Z, Cho K, Gaziano JM, Liao KP, Cai T, Cai T. Knowledge-Driven Online Multimodal Automated Phenotyping System. medRxiv 2023:2023.09.29.23296239. [PMID: 37873131 PMCID: PMC10593060 DOI: 10.1101/2023.09.29.23296239] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/25/2023]
Abstract
Though electronic health record (EHR) systems are a rich repository of clinical information with large potential, the use of EHR-based phenotyping algorithms is often hindered by inaccurate diagnostic records, the presence of many irrelevant features, and the requirement for a human-labeled training set. In this paper, we describe a knowledge-driven online multimodal automated phenotyping (KOMAP) system that i) generates a list of informative features by an online narrative and codified feature search engine (ONCE) and ii) enables the training of a multimodal phenotyping algorithm based on summary data. Powered by composite knowledge from multiple EHR sources, online article corpora, and a large language model, features selected by ONCE show high concordance with the state-of-the-art AI models (GPT4 and ChatGPT) and encourage large-scale phenotyping by providing a smaller but highly relevant feature set. Validation of the KOMAP system across four healthcare centers suggests that it can generate efficient phenotyping algorithms with robust performance. Compared to other methods requiring patient-level inputs and gold-standard labels, the fully online KOMAP provides a significant opportunity to enable multi-center collaboration.
Collapse
|
6
|
Sperotto F, Gutiérrez-Sacristán A, Makwana S, Li X, Rofeberg VN, Cai T, Bourgeois FT, Omenn GS, Hanauer DA, Sáez C, Bonzel CL, Bucholz E, Dionne A, Elias MD, García-Barrio N, González TG, Issitt RW, Kernan KF, Laird-Gion J, Maidlow SE, Mandl KD, Ahooyi TM, Moraleda C, Morris M, Moshal KL, Pedrera-Jiménez M, Shah MA, South AM, Spiridou A, Taylor DM, Verdy G, Visweswaran S, Wang X, Xia Z, Zachariasse JM, Newburger JW, Avillach P. Clinical phenotypes and outcomes in children with multisystem inflammatory syndrome across SARS-CoV-2 variant eras: a multinational study from the 4CE consortium. EClinicalMedicine 2023; 64:102212. [PMID: 37745025 PMCID: PMC10511777 DOI: 10.1016/j.eclinm.2023.102212] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Revised: 08/22/2023] [Accepted: 08/29/2023] [Indexed: 09/26/2023] Open
Abstract
Background Multisystem inflammatory syndrome in children (MIS-C) is a severe complication of SARS-CoV-2 infection. It remains unclear how MIS-C phenotypes vary across SARS-CoV-2 variants. We aimed to investigate clinical characteristics and outcomes of MIS-C across SARS-CoV-2 eras. Methods We performed a multicentre observational retrospective study including seven paediatric hospitals in four countries (France, Spain, U.K., and U.S.). All consecutive confirmed patients with MIS-C hospitalised between February 1st, 2020, and May 31st, 2022, were included. Electronic Health Records (EHR) data were used to calculate pooled risk differences (RD) and effect sizes (ES) at site level, using Alpha as reference. Meta-analysis was used to pool data across sites. Findings Of 598 patients with MIS-C (61% male, 39% female; mean age 9.7 years [SD 4.5]), 383 (64%) were admitted in the Alpha era, 111 (19%) in the Delta era, and 104 (17%) in the Omicron era. Compared with patients admitted in the Alpha era, those admitted in the Delta era were younger (ES -1.18 years [95% CI -2.05, -0.32]), had fewer respiratory symptoms (RD -0.15 [95% CI -0.33, -0.04]), less frequent non-cardiogenic shock or systemic inflammatory response syndrome (SIRS) (RD -0.35 [95% CI -0.64, -0.07]), lower lymphocyte count (ES -0.16 × 109/uL [95% CI -0.30, -0.01]), lower C-reactive protein (ES -28.5 mg/L [95% CI -46.3, -10.7]), and lower troponin (ES -0.14 ng/mL [95% CI -0.26, -0.03]). Patients admitted in the Omicron versus Alpha eras were younger (ES -1.6 years [95% CI -2.5, -0.8]), had less frequent SIRS (RD -0.18 [95% CI -0.30, -0.05]), lower lymphocyte count (ES -0.39 × 109/uL [95% CI -0.52, -0.25]), lower troponin (ES -0.16 ng/mL [95% CI -0.30, -0.01]) and less frequently received anticoagulation therapy (RD -0.19 [95% CI -0.37, -0.04]). Length of hospitalization was shorter in the Delta versus Alpha eras (-1.3 days [95% CI -2.3, -0.4]). Interpretation Our study suggested that MIS-C clinical phenotypes varied across SARS-CoV-2 eras, with patients in Delta and Omicron eras being younger and less sick. EHR data can be effectively leveraged to identify rare complications of pandemic diseases and their variation over time. Funding None.
Collapse
Affiliation(s)
- Francesca Sperotto
- Department of Cardiology, Boston Children's Hospital, Harvard Medical School, 300 Longwood Ave, Boston, MA 02115, United States
| | - Alba Gutiérrez-Sacristán
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, United States
| | - Simran Makwana
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, United States
| | - Xiudi Li
- Department of Biostatistics, Harvard School of Public Health, 677 Huntington Ave, Boston, MA 02115, United States
| | - Valerie N. Rofeberg
- Department of Cardiology, Boston Children's Hospital, Harvard Medical School, 300 Longwood Ave, Boston, MA 02115, United States
| | - Tianxi Cai
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, United States
| | - Florence T. Bourgeois
- Department of Pediatrics, Harvard Medical School, 300 Longwood Ave, Boston, MA 02115, United States
| | - Gilbert S. Omenn
- Dept of Computational Medicine & Bioinformatics, Internal Medicine, Human Genetics, & Public Health, University of Michigan, 2017 Palmer Commons, Ann Arbor, MI 48109-2218, United States
| | - David A. Hanauer
- Department of Learning Health Sciences, University of Michigan Medical School, 100-107 NCRC, 2800 Plymouth Road, Ann Arbor, MI 48109, United States
| | - Carlos Sáez
- Biomedical Data Science Lab, Instituto Universitario de Tecnologías de la Información y Comunicaciones, Universitat Politécnica de Valéncia, Camino de Vera S/N, Valencia 46022, Spain
| | - Clara-Lea Bonzel
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, United States
| | - Emily Bucholz
- Department of Cardiology, Children's Hospital Colorado, University of Colorado Anschutz, 13123 E. 16th Ave, Aurora, CO 80045, United States
| | - Audrey Dionne
- Department of Cardiology, Boston Children's Hospital, Harvard Medical School, 300 Longwood Ave, Boston, MA 02115, United States
| | - Matthew D. Elias
- Division of Cardiology, The Children's Hospital of Philadelphia, 3401 Civic Center Boulevard, Philadelphia, PA 19104, United States
| | - Noelia García-Barrio
- Health Informatics, Hospital Universitario 12 de Octubre, Av. de Córdoba, s/n, Madrid 28041, Spain
| | - Tomás González González
- Health Informatics, Hospital Universitario 12 de Octubre, Av. de Córdoba, s/n, Madrid 28041, Spain
| | - Richard W. Issitt
- Digital Research, Informatics and Virtual Environments (DRIVE), Great Ormond Street Hospital for Children, Great Ormond Street, London WC1N 3JH, United Kingdom
| | - Kate F. Kernan
- Department of Critical Care Medicine, University of Pittsburgh, 3550 Terrace Street, Pittsburgh, PA 15213, United States
| | - Jessica Laird-Gion
- Department of Pediatrics, Boston Children's Hospital, Harvard Medical School, 300 Longwood Ave, Boston, MA 02115, United States
| | - Sarah E. Maidlow
- Michigan Institute for Clinical and Health Research (MICHR) Informatics, University of Michigan, NCRC Bldg 400, 2800 Plymouth Road, Ann Arbor, MI 48109, United States
| | - Kenneth D. Mandl
- Computational Health Informatics Program, Boston Children's Hospital, 300 Longwood Avenue, Boston, MA 02115, United States
| | - Taha Mohseni Ahooyi
- Department of Biomedical Health Informatics, The Children's Hospital of Philadelphia, Roberts Building, 734 Schuylkill Ave, Philadelphia, PA 19146, United States
| | - Cinta Moraleda
- Pediatric Infectious Disease Department, Hospital Universitario 12 de Octubre, Av. de Córdoba, s/n, Madrid 28041, Spain
| | - Michele Morris
- Department of Biomedical Informatics, University of Pittsburgh, 5607 Baum Blvd, Pittsburgh, PA 15206, United States
| | - Karyn L. Moshal
- Department of Infectious Diseases, Great Ormond Street Hospital for Children, Great Ormond Street, London WC1N 3JH, United Kingdom
| | - Miguel Pedrera-Jiménez
- Health Informatics, Hospital Universitario 12 de Octubre, Av. de Córdoba, s/n, Madrid 28041, Spain
| | - Mohsin A. Shah
- Digital Research, Informatics and Virtual Environments (DRIVE), Great Ormond Street Hospital for Children, DRIVE, 40 Bernard St, London WC1N 1LE, United Kingdom
| | - Andrew M. South
- Department of Pediatrics-Section of Nephrology, Brenner Children’s, Wake Forest University School of Medicine, Medical Center Boulevard, Winston Salem, NC 27157, United States
| | - Anastasia Spiridou
- Data Research, Innovation and Virtual Environments, Great Ormond Street Hospital for Children, DRIVE, 40 Bernard St, London WC1N 1LE, United Kingdom
| | - Deanne M. Taylor
- Department of Biomedical Health Informatics, The Children's Hospital of Philadelphia, United States
- The Department of Pediatrics, University of Pennsylvania Perelman Medical School, 3601 Civic Center Blvd, 6032 Colket, Philadelphia, PA 19104, United States
| | - Guillaume Verdy
- IAM Unit, Bordeaux University Hospital, Place amélie rabat Léon, Bordeaux 33076, France
| | - Shyam Visweswaran
- Department of Biomedical Informatics, University of Pittsburgh, 5607 Baum Blvd, Pittsburgh, PA 15206, United States
| | - Xuan Wang
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, United States
| | - Zongqi Xia
- Department of Neurology, University of Pittsburgh, 3501 5th Avenue, BST-3 Suite 7014, Pittsburgh, PA 15260, United States
| | - Joany M. Zachariasse
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, United States
| | - Jane W. Newburger
- Department of Cardiology, Boston Children's Hospital, Harvard Medical School, 300 Longwood Ave, Boston, MA 02115, United States
| | - Paul Avillach
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, United States
- Computational Health Informatics Program, Boston Children's Hospital, 300 Longwood Avenue, Boston, MA 02115, United States
| |
Collapse
|
7
|
Hou J, Zhao R, Gronsbell J, Lin Y, Bonzel CL, Zeng Q, Zhang S, Beaulieu-Jones BK, Weber GM, Jemielita T, Wan SS, Hong C, Cai T, Wen J, Ayakulangara Panickan V, Liaw KL, Liao K, Cai T. Generate Analysis-Ready Data for Real-world Evidence: Tutorial for Harnessing Electronic Health Records With Advanced Informatic Technologies. J Med Internet Res 2023; 25:e45662. [PMID: 37227772 DOI: 10.2196/45662] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Revised: 03/31/2023] [Accepted: 04/05/2023] [Indexed: 05/26/2023] Open
Abstract
Although randomized controlled trials (RCTs) are the gold standard for establishing the efficacy and safety of a medical treatment, real-world evidence (RWE) generated from real-world data has been vital in postapproval monitoring and is being promoted for the regulatory process of experimental therapies. An emerging source of real-world data is electronic health records (EHRs), which contain detailed information on patient care in both structured (eg, diagnosis codes) and unstructured (eg, clinical notes and images) forms. Despite the granularity of the data available in EHRs, the critical variables required to reliably assess the relationship between a treatment and clinical outcome are challenging to extract. To address this fundamental challenge and accelerate the reliable use of EHRs for RWE, we introduce an integrated data curation and modeling pipeline consisting of 4 modules that leverage recent advances in natural language processing, computational phenotyping, and causal modeling techniques with noisy data. Module 1 consists of techniques for data harmonization. We use natural language processing to recognize clinical variables from RCT design documents and map the extracted variables to EHR features with description matching and knowledge networks. Module 2 then develops techniques for cohort construction using advanced phenotyping algorithms to both identify patients with diseases of interest and define the treatment arms. Module 3 introduces methods for variable curation, including a list of existing tools to extract baseline variables from different sources (eg, codified, free text, and medical imaging) and end points of various types (eg, death, binary, temporal, and numerical). Finally, module 4 presents validation and robust modeling methods, and we propose a strategy to create gold-standard labels for EHR variables of interest to validate data curation quality and perform subsequent causal modeling for RWE. In addition to the workflow proposed in our pipeline, we also develop a reporting guideline for RWE that covers the necessary information to facilitate transparent reporting and reproducibility of results. Moreover, our pipeline is highly data driven, enhancing study data with a rich variety of publicly available information and knowledge sources. We also showcase our pipeline and provide guidance on the deployment of relevant tools by revisiting the emulation of the Clinical Outcomes of Surgical Therapy Study Group Trial on laparoscopy-assisted colectomy versus open colectomy in patients with early-stage colon cancer. We also draw on existing literature on EHR emulation of RCTs together with our own studies with the Mass General Brigham EHR.
Collapse
Affiliation(s)
- Jue Hou
- Division of Biostatistics, School of Public Health, University of Minnesota, Minneapolis, MN, United States
| | - Rachel Zhao
- Department of Medicine, University of British Columbia, Vancouver, BC, Canada
| | - Jessica Gronsbell
- Department of Statistical Sciences, University of Toronto, Toronto, ON, Canada
| | - Yucong Lin
- Institute of Engineering Medicine, Beijing Institute of Technology, Beijing, China
| | - Clara-Lea Bonzel
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Qingyi Zeng
- Division of Biostatistics, School of Public Health, University of Minnesota, Minneapolis, MN, United States
| | - Sinian Zhang
- School of Statistics, Renmin University of China, Bejing, China
| | | | - Griffin M Weber
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | | | | | - Chuan Hong
- Department of Biostatistics & Bioinformatics, Duke University, Durham, NC, United States
| | - Tianrun Cai
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Jun Wen
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | | | | | - Katherine Liao
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
- Division of Rheumatology, Inflammation, and Immunity, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States
| | - Tianxi Cai
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
- Department of Biostatistics, Harvard TH Chan School of Public Health, Boston, MA, United States
| |
Collapse
|
8
|
Gan Z, Zhou D, Rush E, Panickan VA, Ho YL, Ostrouchov G, Xu Z, Shen S, Xiong X, Greco KF, Hong C, Bonzel CL, Wen J, Costa L, Cai T, Begoli E, Xia Z, Gaziano JM, Liao KP, Cho K, Cai T, Lu J. ARCH: Large-scale Knowledge Graph via Aggregated Narrative Codified Health Records Analysis. medRxiv 2023:2023.05.14.23289955. [PMID: 37293026 PMCID: PMC10246054 DOI: 10.1101/2023.05.14.23289955] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Objective Electronic health record (EHR) systems contain a wealth of clinical data stored as both codified data and free-text narrative notes, covering hundreds of thousands of clinical concepts available for research and clinical care. The complex, massive, heterogeneous, and noisy nature of EHR data imposes significant challenges for feature representation, information extraction, and uncertainty quantification. To address these challenges, we proposed an efficient Aggregated naRrative Codified Health (ARCH) records analysis to generate a large-scale knowledge graph (KG) for a comprehensive set of EHR codified and narrative features. Methods The ARCH algorithm first derives embedding vectors from a co-occurrence matrix of all EHR concepts and then generates cosine similarities along with associated p -values to measure the strength of relatedness between clinical features with statistical certainty quantification. In the final step, ARCH performs a sparse embedding regression to remove indirect linkage between entity pairs. We validated the clinical utility of the ARCH knowledge graph, generated from 12.5 million patients in the Veterans Affairs (VA) healthcare system, through downstream tasks including detecting known relationships between entity pairs, predicting drug side effects, disease phenotyping, as well as sub-typing Alzheimer's disease patients. Results ARCH produces high-quality clinical embeddings and KG for over 60,000 EHR concepts, as visualized in the R-shiny powered web-API (https://celehs.hms.harvard.edu/ARCH/). The ARCH embeddings attained an average area under the ROC curve (AUC) of 0.926 and 0.861 for detecting pairs of similar EHR concepts when the concepts are mapped to codified data and to NLP data; and 0.810 (codified) and 0.843 (NLP) for detecting related pairs. Based on the p -values computed by ARCH, the sensitivity of detecting similar and related entity pairs are 0.906 and 0.888 under false discovery rate (FDR) control of 5%. For detecting drug side effects, the cosine similarity based on the ARCH semantic representations achieved an AUC of 0.723 while the AUC improved to 0.826 after few-shot training via minimizing the loss function on the training data set. Incorporating NLP data substantially improved the ability to detect side effects in the EHR. For example, based on unsupervised ARCH embeddings, the power of detecting drug-side effects pairs when using codified data only was 0.15, much lower than the power of 0.51 when using both codified and NLP concepts. Compared to existing large-scale representation learning methods including PubmedBERT, BioBERT and SAPBERT, ARCH attains the most robust performance and substantially higher accuracy in detecting these relationships. Incorporating ARCH selected features in weakly supervised phenotyping algorithms can improve the robustness of algorithm performance, especially for diseases that benefit from NLP features as supporting evidence. For example, the phenotyping algorithm for depression attained an AUC of 0.927 when using ARCH selected features but only 0.857 when using codified features selected via the KESER network[1]. In addition, embeddings and knowledge graphs generated from the ARCH network were able to cluster AD patients into two subgroups, where the fast progression subgroup had a much higher mortality rate. Conclusions The proposed ARCH algorithm generates large-scale high-quality semantic representations and knowledge graph for both codified and NLP EHR features, useful for a wide range of predictive modeling tasks.
Collapse
Affiliation(s)
| | - Doudou Zhou
- Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Everett Rush
- Oak Ridge National Laboratory, Oak Ridge, TN USA
| | - Vidul A Panickan
- Harvard Medical School, Boston, MA, USA
- VA Boston Healthcare System, Boston, MA, USA
| | - Yuk-Lam Ho
- VA Boston Healthcare System, Boston, MA, USA
| | | | - Zhiwei Xu
- University of Michigan, Ann Arbor, MI, USA
| | - Shuting Shen
- Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Xin Xiong
- Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | | | | | - Clara-Lea Bonzel
- Harvard Medical School, Boston, MA, USA
- VA Boston Healthcare System, Boston, MA, USA
| | - Jun Wen
- Harvard Medical School, Boston, MA, USA
| | | | - Tianrun Cai
- VA Boston Healthcare System, Boston, MA, USA
- Brigham and Women's Hospital, Boston, MA, USA
| | - Edmon Begoli
- Oak Ridge National Laboratory, Oak Ridge, TN USA
| | - Zongqi Xia
- University of Pittsburgh, Pittsburgh, USA
| | - J Michael Gaziano
- Harvard Medical School, Boston, MA, USA
- VA Boston Healthcare System, Boston, MA, USA
- Brigham and Women's Hospital, Boston, MA, USA
| | - Katherine P Liao
- VA Boston Healthcare System, Boston, MA, USA
- Brigham and Women's Hospital, Boston, MA, USA
| | - Kelly Cho
- Harvard Medical School, Boston, MA, USA
- VA Boston Healthcare System, Boston, MA, USA
- Brigham and Women's Hospital, Boston, MA, USA
| | - Tianxi Cai
- Harvard T.H. Chan School of Public Health, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
- VA Boston Healthcare System, Boston, MA, USA
| | - Junwei Lu
- Harvard T.H. Chan School of Public Health, Boston, MA, USA
- VA Boston Healthcare System, Boston, MA, USA
| |
Collapse
|
9
|
Tan ALM, Getzen EJ, Hutch MR, Strasser ZH, Gutiérrez-Sacristán A, Le TT, Dagliati A, Morris M, Hanauer DA, Moal B, Bonzel CL, Yuan W, Chiudinelli L, Das P, Zhang HG, Aronow BJ, Avillach P, Brat GA, Cai T, Hong C, La Cava WG, Hooi Will Loh H, Luo Y, Murphy SN, Yuan Hgiam K, Omenn GS, Patel LP, Jebathilagam Samayamuthu M, Shriver ER, Shakeri Hossein Abad Z, Tan BWL, Visweswaran S, Wang X, Weber GM, Xia Z, Verdy B, Long Q, Mowery DL, Holmes JH. Informative missingness: What can we learn from patterns in missing laboratory data in the electronic health record? J Biomed Inform 2023; 139:104306. [PMID: 36738870 PMCID: PMC10849195 DOI: 10.1016/j.jbi.2023.104306] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Revised: 01/21/2023] [Accepted: 01/29/2023] [Indexed: 02/05/2023]
Abstract
BACKGROUND In electronic health records, patterns of missing laboratory test results could capture patients' course of disease as well as reflect clinician's concerns or worries for possible conditions. These patterns are often understudied and overlooked. This study aims to identify informative patterns of missingness among laboratory data collected across 15 healthcare system sites in three countries for COVID-19 inpatients. METHODS We collected and analyzed demographic, diagnosis, and laboratory data for 69,939 patients with positive COVID-19 PCR tests across three countries from 1 January 2020 through 30 September 2021. We analyzed missing laboratory measurements across sites, missingness stratification by demographic variables, temporal trends of missingness, correlations between labs based on missingness indicators over time, and clustering of groups of labs based on their missingness/ordering pattern. RESULTS With these analyses, we identified mapping issues faced in seven out of 15 sites. We also identified nuances in data collection and variable definition for the various sites. Temporal trend analyses may support the use of laboratory test result missingness patterns in identifying severe COVID-19 patients. Lastly, using missingness patterns, we determined relationships between various labs that reflect clinical behaviors. CONCLUSION In this work, we use computational approaches to relate missingness patterns to hospital treatment capacity and highlight the heterogeneity of looking at COVID-19 over time and at multiple sites, where there might be different phases, policies, etc. Changes in missingness could suggest a change in a patient's condition, and patterns of missingness among laboratory measurements could potentially identify clinical outcomes. This allows sites to consider missing data as informative to analyses and help researchers identify which sites are better poised to study particular questions.
Collapse
Affiliation(s)
| | - Emily J Getzen
- University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
| | | | | | | | - Trang T Le
- University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
| | | | | | | | | | | | | | | | - Priam Das
- Harvard Medical School, Cambridge, MA, USA
| | | | - Bruce J Aronow
- Cincinnati Children's Hospital Medical Center, University of Cincinnati, Cincinnati, OH, USA
| | | | | | - Tianxi Cai
- Harvard Medical School, Cambridge, MA, USA
| | - Chuan Hong
- Harvard Medical School, Cambridge, MA, USA; Duke University, Durham, NC, USA
| | - William G La Cava
- Harvard Medical School, Cambridge, MA, USA; Boston Children's Hospital, Boston, MA, USA
| | | | - Yuan Luo
- Northwestern University, Chicago, IL, USA
| | | | | | | | - Lav P Patel
- University of Kansas Medical Center, United States
| | | | - Emily R Shriver
- University of Pennsylvania Health System, Philadelphia, PA, USA
| | | | | | | | - Xuan Wang
- Harvard Medical School, Cambridge, MA, USA
| | | | - Zongqi Xia
- University of Pittsburgh, Pittsburgh, PA, USA
| | | | - Qi Long
- University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
| | - Danielle L Mowery
- University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
| | - John H Holmes
- University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
| |
Collapse
|
10
|
Moal B, Orieux A, Ferté T, Neuraz A, Brat GA, Avillach P, Bonzel CL, Cai T, Cho K, Cossin S, Griffier R, Hanauer DA, Haverkamp C, Ho YL, Hong C, Hutch MR, Klann JG, Le TT, Loh NHW, Luo Y, Makoudjou A, Morris M, Mowery DL, Olson KL, Patel LP, Samayamuthu MJ, Sanz Vidorreta FJ, Schriver ER, Schubert P, Verdy G, Visweswaran S, Wang X, Weber GM, Xia Z, Yuan W, Zhang HG, Zöller D, Kohane IS, Boyer A, Jouhet V. Acute respiratory distress syndrome after SARS-CoV-2 infection on young adult population: International observational federated study based on electronic health records through the 4CE consortium. PLoS One 2023; 18:e0266985. [PMID: 36598895 DOI: 10.1371/journal.pone.0266985] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2022] [Accepted: 11/09/2022] [Indexed: 01/05/2023] Open
Abstract
PURPOSE In young adults (18 to 49 years old), investigation of the acute respiratory distress syndrome (ARDS) after severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection has been limited. We evaluated the risk factors and outcomes of ARDS following infection with SARS-CoV-2 in a young adult population. METHODS A retrospective cohort study was conducted between January 1st, 2020 and February 28th, 2021 using patient-level electronic health records (EHR), across 241 United States hospitals and 43 European hospitals participating in the Consortium for Clinical Characterization of COVID-19 by EHR (4CE). To identify the risk factors associated with ARDS, we compared young patients with and without ARDS through a federated analysis. We further compared the outcomes between young and old patients with ARDS. RESULTS Among the 75,377 hospitalized patients with positive SARS-CoV-2 PCR, 1001 young adults presented with ARDS (7.8% of young hospitalized adults). Their mortality rate at 90 days was 16.2% and they presented with a similar complication rate for infection than older adults with ARDS. Peptic ulcer disease, paralysis, obesity, congestive heart failure, valvular disease, diabetes, chronic pulmonary disease and liver disease were associated with a higher risk of ARDS. We described a high prevalence of obesity (53%), hypertension (38%- although not significantly associated with ARDS), and diabetes (32%). CONCLUSION Trough an innovative method, a large international cohort study of young adults developing ARDS after SARS-CoV-2 infection has been gather. It demonstrated the poor outcomes of this population and associated risk factor.
Collapse
Affiliation(s)
- Bertrand Moal
- IAM Unit, Bordeaux University Hospital, Bordeaux, France
| | - Arthur Orieux
- Medical Intensive Care Unit, Bordeaux University Hospital, Bordeaux, France
| | - Thomas Ferté
- Inserm Bordeaux Population Health Research Center UMR 1219, Inria BSO, Team SISTM, University of Bordeaux, Bordeaux, France
| | - Antoine Neuraz
- Department of Biomedical Informatics, Hôpital Necker-Enfants Malade, Assistance Publique Hôpitaux de Paris (APHP), University of Paris, Paris, France
| | - Gabriel A Brat
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Paul Avillach
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Clara-Lea Bonzel
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Tianxi Cai
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Kelly Cho
- Population Health and Data Science, MAVERIC, VA Boston Healthcare System, Boston, Massachusetts, United States of America
| | - Sébastien Cossin
- INSERM Bordeaux Population Health ERIAS TEAM, Bordeaux University Hospital / ERIAS - Inserm U1219 BPH, Bordeaux, France
| | - Romain Griffier
- Institute of Digitalization in Medicine, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
| | - David A Hanauer
- IAM Unit, INSERM Bordeaux Population Health ERIAS TEAM, Bordeaux University Hospital / ERIAS - Inserm U1219 BPH, Bordeaux, France
| | - Christian Haverkamp
- Department of Learning Health Sciences, University of Michigan, Ann Arbor, Michigan, United States of America
| | - Yuk-Lam Ho
- Institute of Digitalization in Medicine, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
| | - Chuan Hong
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Meghan R Hutch
- Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), VA Boston Healthcare System, Boston, Massachusetts, United States of America
| | - Jeffrey G Klann
- Department of Preventive Medicine, Northwestern University, Chicago, Illinois, United States of America
| | - Trang T Le
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Ne Hooi Will Loh
- Department of Medicine, Massachusetts General Hospital, Boston, Massachusetts, United States of America
| | - Yuan Luo
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
| | - Adeline Makoudjou
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, United States of America
| | - Michele Morris
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Danielle L Mowery
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Karen L Olson
- Department of Anaesthesia, National University Health System, Singapore, Singapore
| | - Lav P Patel
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
| | - Malarkodi J Samayamuthu
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Fernando J Sanz Vidorreta
- Computational Health Informatics Program, Boston Children's Hospital, Department of Pediatrics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Emily R Schriver
- Department of Internal Medicine, Division of Medical Informatics, University of Kansas Medical Center, Kansas City, Kansas, United States of America
| | - Petra Schubert
- Department of Medicine, David Geffen School of Medicine at UCLA, Los Angeles, California, United States of America
| | | | - Shyam Visweswaran
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Xuan Wang
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Griffin M Weber
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Zongqi Xia
- Data Analytics Center, University of Pennsylvania Health System, Philadelphia, Pennsylvania, United States of America
| | - William Yuan
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Harrison G Zhang
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Daniela Zöller
- Department of Neurology, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America
| | - Isaac S Kohane
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Alexandre Boyer
- Medical Intensive Care Unit, Bordeaux University Hospital, Bordeaux, France
| | - Vianney Jouhet
- Institute of Digitalization in Medicine, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
| |
Collapse
|
11
|
Tan BW, Tan BW, Tan AL, Schriver ER, Gutiérrez-Sacristán A, Das P, Yuan W, Hutch MR, García Barrio N, Pedrera Jimenez M, Abu-el-rub N, Morris M, Moal B, Verdy G, Cho K, Ho YL, Patel LP, Dagliati A, Neuraz A, Klann JG, South AM, Visweswaran S, Hanauer DA, Maidlow SE, Liu M, Mowery DL, Batugo A, Makoudjou A, Tippmann P, Zöller D, Brat GA, Luo Y, Avillach P, Bellazzi R, Chiovato L, Malovini A, Tibollo V, Samayamuthu MJ, Serrano Balazote P, Xia Z, Loh NHW, Chiudinelli L, Bonzel CL, Hong C, Zhang HG, Weber GM, Kohane IS, Cai T, Omenn GS, Holmes JH, Ngiam KY. Long-term kidney function recovery and mortality after COVID-19-associated acute kidney injury: An international multi-centre observational cohort study. EClinicalMedicine 2023; 55:101724. [PMID: 36381999 PMCID: PMC9640184 DOI: 10.1016/j.eclinm.2022.101724] [Citation(s) in RCA: 20] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Revised: 10/12/2022] [Accepted: 10/12/2022] [Indexed: 11/09/2022] Open
Abstract
Background While acute kidney injury (AKI) is a common complication in COVID-19, data on post-AKI kidney function recovery and the clinical factors associated with poor kidney function recovery is lacking. Methods A retrospective multi-centre observational cohort study comprising 12,891 hospitalized patients aged 18 years or older with a diagnosis of SARS-CoV-2 infection confirmed by polymerase chain reaction from 1 January 2020 to 10 September 2020, and with at least one serum creatinine value 1-365 days prior to admission. Mortality and serum creatinine values were obtained up to 10 September 2021. Findings Advanced age (HR 2.77, 95%CI 2.53-3.04, p < 0.0001), severe COVID-19 (HR 2.91, 95%CI 2.03-4.17, p < 0.0001), severe AKI (KDIGO stage 3: HR 4.22, 95%CI 3.55-5.00, p < 0.0001), and ischemic heart disease (HR 1.26, 95%CI 1.14-1.39, p < 0.0001) were associated with worse mortality outcomes. AKI severity (KDIGO stage 3: HR 0.41, 95%CI 0.37-0.46, p < 0.0001) was associated with worse kidney function recovery, whereas remdesivir use (HR 1.34, 95%CI 1.17-1.54, p < 0.0001) was associated with better kidney function recovery. In a subset of patients without chronic kidney disease, advanced age (HR 1.38, 95%CI 1.20-1.58, p < 0.0001), male sex (HR 1.67, 95%CI 1.45-1.93, p < 0.0001), severe AKI (KDIGO stage 3: HR 11.68, 95%CI 9.80-13.91, p < 0.0001), and hypertension (HR 1.22, 95%CI 1.10-1.36, p = 0.0002) were associated with post-AKI kidney function impairment. Furthermore, patients with COVID-19-associated AKI had significant and persistent elevations of baseline serum creatinine 125% or more at 180 days (RR 1.49, 95%CI 1.32-1.67) and 365 days (RR 1.54, 95%CI 1.21-1.96) compared to COVID-19 patients with no AKI. Interpretation COVID-19-associated AKI was associated with higher mortality, and severe COVID-19-associated AKI was associated with worse long-term post-AKI kidney function recovery. Funding Authors are supported by various funders, with full details stated in the acknowledgement section.
Collapse
Affiliation(s)
- Byorn W.L. Tan
- Department of Medicine, National University Hospital, 1E Kent Ridge Road, NUHS Tower Block Level 10, Singapore 119228
| | - Bryce W.Q. Tan
- Department of Medicine, National University Hospital, 1E Kent Ridge Road, NUHS Tower Block Level 10, Singapore 119228
| | - Amelia L.M. Tan
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - Emily R. Schriver
- Data Analytics Center, University of Pennsylvania Health System, 3600 Civic Center Boulevard, Philadelphia, PA 19104, USA
| | - Alba Gutiérrez-Sacristán
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - Priyam Das
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - William Yuan
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - Meghan R. Hutch
- Department of Preventive Medicine, Northwestern University, 750 North Lake Shore Drive, Chicago, IL 60611, USA
| | - Noelia García Barrio
- Department of Health Informatics, Hospital Universitario 12 de Octubre, Av. de Córdoba, s/n 28041 Madrid, Spain
| | - Miguel Pedrera Jimenez
- Department of Health Informatics, Hospital Universitario 12 de Octubre, Av. de Córdoba, s/n 28041 Madrid, Spain
| | - Noor Abu-el-rub
- Department of Internal Medicine, Division of Medical Informatics, University of Kansas Medical Center, 3901 Rainbow Blvd, Kansas City, KS 66160, USA
| | - Michele Morris
- Department of Biomedical Informatics, University of Pittsburgh, 5607 Baum Blvd, Pittsburgh, PA 15206, USA
| | - Bertrand Moal
- IAM Unit, Bordeaux University Hospital, Place Amélie Rabat Léon, 33076 Bordeaux, France
| | - Guillaume Verdy
- IAM Unit, Bordeaux University Hospital, Place Amélie Rabat Léon, 33076 Bordeaux, France
| | - Kelly Cho
- Massachusetts Veterans Epidemiology Research and Information Center, VA Boston Healthcare System, 2 Avenue De Lafayette, Boston, MA 02130, USA
| | - Yuk-Lam Ho
- Massachusetts Veterans Epidemiology Research and Information Center, VA Boston Healthcare System, 2 Avenue De Lafayette, Boston, MA 02130, USA
| | - Lav P. Patel
- Department of Internal Medicine, Division of Medical Informatics, University of Kansas Medical Center, 3901 Rainbow Blvd, Kansas City, KS 66160, USA
| | - Arianna Dagliati
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Italy, Via Ferrata 5, 27100 Pavia, Italy
| | - Antoine Neuraz
- Department of Biomedical Informatics, Hôpital Necker-Enfants Malade, Assistance Publique Hôpitaux de Paris, University of Paris, 149 Rue de Sèvres, 75015 Paris, France
| | - Jeffrey G. Klann
- Department of Medicine, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA
| | - Andrew M. South
- Department of Pediatrics-Section of Nephrology, Brenner Children's Hospital, Wake Forest School of Medicine, Medical Center Boulevard, Winston Salem, NC 27157, USA
| | - Shyam Visweswaran
- Department of Biomedical Informatics, University of Pittsburgh, 5607 Baum Blvd, Pittsburgh, PA 15206, USA
| | - David A. Hanauer
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, Michigan, USA, 100-107 NCRC, 2800 Plymouth Road, Ann Arbor, MI 48109, USA
| | - Sarah E. Maidlow
- Michigan Institute for Clinical and Health Research (MICHR) Informatics, University of Michigan, NCRC Bldg 400, 2800 Plymouth Road, Ann Arbor, MI, United States
| | - Mei Liu
- Department of Internal Medicine, Division of Medical Informatics, University of Kansas Medical Center, 3901 Rainbow Blvd, Kansas City, KS 66160, USA
| | - Danielle L. Mowery
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, 3700 Hamilton Walk, Richards Hall, A202, Philadelphia, PA 19104, USA
| | - Ashley Batugo
- Institute for Biomedical Informatics, University of Pennsylvania Perelman School of Medicine, 401 Blockley Hall 423 Guardian Drive Philadelphia, PA 19104, USA
| | - Adeline Makoudjou
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Zinkmattenstraße 6a, DE79108 Freiburg, Germany
| | - Patric Tippmann
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Zinkmattenstraße 6a, DE79108 Freiburg, Germany
| | - Daniela Zöller
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Zinkmattenstraße 6a, DE79108 Freiburg, Germany
| | - Gabriel A. Brat
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - Yuan Luo
- Department of Preventive Medicine, Northwestern University, 750 North Lake Shore Drive, Chicago, IL 60611, USA
| | - Paul Avillach
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - Riccardo Bellazzi
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Italy, Via Ferrata 5, 27100 Pavia, Italy
| | - Luca Chiovato
- Unit of Internal Medicine and Endocrinology, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Via Maugeri 4, 27100 Pavia, Italy
| | - Alberto Malovini
- Laboratory of Informatics and Systems Engineering for Clinical Research, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Italy., Via Maugeri 4, 27100 Pavia, Italy
| | - Valentina Tibollo
- Laboratory of Informatics and Systems Engineering for Clinical Research, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Italy., Via Maugeri 4, 27100 Pavia, Italy
| | | | - Pablo Serrano Balazote
- Department of Health Informatics, Hospital Universitario 12 de Octubre, Av. de Córdoba, s/n 28041 Madrid, Spain
| | - Zongqi Xia
- Department of Neurology, University of Pittsburgh, 3501 5th Avenue, BST-3 Suite 7014, Pittsburgh, PA 15260, USA
| | - Ne Hooi Will Loh
- Department of Anaesthesia, National University Health System, 5 Lower Kent Ridge Road, Singapore 119074
| | - Lorenzo Chiudinelli
- UOC Ricerca, Innovazione e Brand reputation, ASST Papa Giovanni XXIII, Bergamo, P.zza OMS 1 - 24127 Bergamo, Italy
| | - Clara-Lea Bonzel
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - Chuan Hong
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
- Department of Biostatistics and Bioinformatics, Duke University, 2424 Erwin Road, Durham, NC, United States
| | - Harrison G. Zhang
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - Griffin M. Weber
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - Isaac S. Kohane
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - Tianxi Cai
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Boston, MA 02115, USA
| | - Gilbert S. Omenn
- Department of Computational Medicine & Bioinformatics, University of Michigan, 2017B Palmer Commons, 100 Washtenaw, Ann Arbor, MI 48109-2218
| | - John H. Holmes
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, 3700 Hamilton Walk, Richards Hall, A202, Philadelphia, PA 19104, USA
- Institute for Biomedical Informatics, University of Pennsylvania Perelman School of Medicine, 401 Blockley Hall 423 Guardian Drive Philadelphia, PA 19104, USA
| | - Kee Yuan Ngiam
- Department of Biomedical Informatics, WiSDM, National University Health Systems Singapore, 1E Kent Ridge Road, NUHS Tower Block Level 8, Singapore 119228
- Corresponding author. Department of Biomedical Informatics, WiSDM, National University Health Systems Singapore, 1E Kent Ridge Road, NUHS Tower Block Level 8, Singapore 119228.
| | | |
Collapse
|
12
|
Gutiérrez-Sacristán A, Serret-Larmande A, Hutch MR, Sáez C, Aronow BJ, Bhatnagar S, Bonzel CL, Cai T, Devkota B, Hanauer DA, Loh NHW, Luo Y, Moal B, Ahooyi TM, Njoroge WFM, Omenn GS, Sanchez-Pinto LN, South AM, Sperotto F, Tan ALM, Taylor DM, Verdy G, Visweswaran S, Xia Z, Zahner J, Avillach P, Bourgeois FT. Hospitalizations Associated With Mental Health Conditions Among Adolescents in the US and France During the COVID-19 Pandemic. JAMA Netw Open 2022; 5:e2246548. [PMID: 36512353 PMCID: PMC9856226 DOI: 10.1001/jamanetworkopen.2022.46548] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Accepted: 10/21/2022] [Indexed: 12/15/2022] Open
Abstract
Importance The COVID-19 pandemic has been associated with an increase in mental health diagnoses among adolescents, though the extent of the increase, particularly for severe cases requiring hospitalization, has not been well characterized. Large-scale federated informatics approaches provide the ability to efficiently and securely query health care data sets to assess and monitor hospitalization patterns for mental health conditions among adolescents. Objective To estimate changes in the proportion of hospitalizations associated with mental health conditions among adolescents following onset of the COVID-19 pandemic. Design, Setting, and Participants This retrospective, multisite cohort study of adolescents 11 to 17 years of age who were hospitalized with at least 1 mental health condition diagnosis between February 1, 2019, and April 30, 2021, used patient-level data from electronic health records of 8 children's hospitals in the US and France. Main Outcomes and Measures Change in the monthly proportion of mental health condition-associated hospitalizations between the prepandemic (February 1, 2019, to March 31, 2020) and pandemic (April 1, 2020, to April 30, 2021) periods using interrupted time series analysis. Results There were 9696 adolescents hospitalized with a mental health condition during the prepandemic period (5966 [61.5%] female) and 11 101 during the pandemic period (7603 [68.5%] female). The mean (SD) age in the prepandemic cohort was 14.6 (1.9) years and in the pandemic cohort, 14.7 (1.8) years. The most prevalent diagnoses during the pandemic were anxiety (6066 [57.4%]), depression (5065 [48.0%]), and suicidality or self-injury (4673 [44.2%]). There was an increase in the proportions of monthly hospitalizations during the pandemic for anxiety (0.55%; 95% CI, 0.26%-0.84%), depression (0.50%; 95% CI, 0.19%-0.79%), and suicidality or self-injury (0.38%; 95% CI, 0.08%-0.68%). There was an estimated 0.60% increase (95% CI, 0.31%-0.89%) overall in the monthly proportion of mental health-associated hospitalizations following onset of the pandemic compared with the prepandemic period. Conclusions and Relevance In this cohort study, onset of the COVID-19 pandemic was associated with increased hospitalizations with mental health diagnoses among adolescents. These findings support the need for greater resources within children's hospitals to care for adolescents with mental health conditions during the pandemic and beyond.
Collapse
Affiliation(s)
| | - Arnaud Serret-Larmande
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
- Department of Biostatistics and Biomedical Informatics, Hôpital Saint-Louis, Assistance Publique-Hôpitaux de Paris, Université Paris-Cité, Paris, France
| | - Meghan R Hutch
- Department of Preventive Medicine, Northwestern University, Chicago, Illinois
| | - Carlos Sáez
- Biomedical Data Science Lab, Instituto Universitario de Tecnologías de la Información y Comunicaciones, Universitat Politècnica de València, València, Spain
| | - Bruce J Aronow
- Department of Biomedical Informatics, Cincinnati Children's Hospital Medical Center, University of Cincinnati, Cincinnati, Ohio
- Department of Pediatrics, Cincinnati Children's Hospital Medical Center, University of Cincinnati, Cincinnati, Ohio
| | - Surbhi Bhatnagar
- Department of Biomedical Informatics, Cincinnati Children's Hospital Medical Center, University of Cincinnati, Cincinnati, Ohio
- Department of Pediatrics, Cincinnati Children's Hospital Medical Center, University of Cincinnati, Cincinnati, Ohio
| | - Clara-Lea Bonzel
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
| | - Tianxi Cai
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
| | - Batsal Devkota
- Department of Biomedical and Health Informatics, The Children's Hospital of Philadelphia, Philadelphia, Pennsylvania
| | - David A Hanauer
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor
| | - Ne Hooi Will Loh
- Department of Anaesthesia, National University Health System, Singapore
| | - Yuan Luo
- Department of Preventive Medicine, Northwestern University, Chicago, Illinois
| | - Bertrand Moal
- Unité Informatique et Archivistique Médicale, Bordeaux University Hospital, Bordeaux, France
| | - Taha Mohseni Ahooyi
- Department of Biomedical and Health Informatics, The Children's Hospital of Philadelphia, Philadelphia, Pennsylvania
| | - Wanjiku F M Njoroge
- Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia
| | - Gilbert S Omenn
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor
| | - L Nelson Sanchez-Pinto
- Department of Pediatrics (Critical Care), Northwestern University Feinberg School of Medicine, Chicago, Illinois
| | - Andrew M South
- Department of Pediatrics-Section of Nephrology, Brenner Children's, Wake Forest University School of Medicine, Winston Salem, North Carolina
| | - Francesca Sperotto
- Department of Cardiology, Boston Children's Hospital, Harvard Medical School, Boston, Massachusetts
| | - Amelia L M Tan
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
| | - Deanne M Taylor
- Department of Biomedical and Health Informatics, The Children's Hospital of Philadelphia, Philadelphia, Pennsylvania
- Department of Pediatrics, University of Pennsylvania Perelman School of Medicine, Philadelphia
| | - Guillaume Verdy
- Unité Informatique et Archivistique Médicale, Bordeaux University Hospital, Bordeaux, France
| | - Shyam Visweswaran
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, Pennsylvania
| | - Zongqi Xia
- Department of Neurology, University of Pittsburgh, Pittsburgh, Pennsylvania
| | - Janet Zahner
- Department of Information Services, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio
- Department of Biomedical Informatics, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio
- Department of Pediatrics, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio
| | - Paul Avillach
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
- Computational Health Informatics Program, Boston Children's Hospital, Boston, Massachusetts
| | - Florence T Bourgeois
- Computational Health Informatics Program, Boston Children's Hospital, Boston, Massachusetts
- Department of Pediatrics, Harvard Medical School, Boston, Massachusetts
| |
Collapse
|
13
|
Wang X, Zhang HG, Xiong X, Hong C, Weber GM, Brat GA, Bonzel CL, Luo Y, Duan R, Palmer NP, Hutch MR, Gutiérrez-Sacristán A, Bellazzi R, Chiovato L, Cho K, Dagliati A, Estiri H, García-Barrio N, Griffier R, Hanauer DA, Ho YL, Holmes JH, Keller MS, Klann MEng JG, L'Yi S, Lozano-Zahonero S, Maidlow SE, Makoudjou A, Malovini A, Moal B, Moore JH, Morris M, Mowery DL, Murphy SN, Neuraz A, Yuan Ngiam K, Omenn GS, Patel LP, Pedrera-Jiménez M, Prunotto A, Jebathilagam Samayamuthu M, Sanz Vidorreta FJ, Schriver ER, Schubert P, Serrano-Balazote P, South AM, Tan ALM, Tan BWL, Tibollo V, Tippmann P, Visweswaran S, Xia Z, Yuan W, Zöller D, Kohane IS, Avillach P, Guo Z, Cai T. SurvMaximin: Robust federated approach to transporting survival risk prediction models. J Biomed Inform 2022; 134:104176. [PMID: 36007785 PMCID: PMC9707637 DOI: 10.1016/j.jbi.2022.104176] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2022] [Revised: 07/18/2022] [Accepted: 08/15/2022] [Indexed: 10/15/2022]
Abstract
OBJECTIVE For multi-center heterogeneous Real-World Data (RWD) with time-to-event outcomes and high-dimensional features, we propose the SurvMaximin algorithm to estimate Cox model feature coefficients for a target population by borrowing summary information from a set of health care centers without sharing patient-level information. MATERIALS AND METHODS For each of the centers from which we want to borrow information to improve the prediction performance for the target population, a penalized Cox model is fitted to estimate feature coefficients for the center. Using estimated feature coefficients and the covariance matrix of the target population, we then obtain a SurvMaximin estimated set of feature coefficients for the target population. The target population can be an entire cohort comprised of all centers, corresponding to federated learning, or a single center, corresponding to transfer learning. RESULTS Simulation studies and a real-world international electronic health records application study, with 15 participating health care centers across three countries (France, Germany, and the U.S.), show that the proposed SurvMaximin algorithm achieves comparable or higher accuracy compared with the estimator using only the information of the target site and other existing methods. The SurvMaximin estimator is robust to variations in sample sizes and estimated feature coefficients between centers, which amounts to significantly improved estimates for target sites with fewer observations. CONCLUSIONS The SurvMaximin method is well suited for both federated and transfer learning in the high-dimensional survival analysis setting. SurvMaximin only requires a one-time summary information exchange from participating centers. Estimated regression vectors can be very heterogeneous. SurvMaximin provides robust Cox feature coefficient estimates without outcome information in the target population and is privacy-preserving.
Collapse
Affiliation(s)
- Xuan Wang
- Department of Biostatistics, Harvard T. H. Chan School of Public Health, Boston, MA, USA
| | - Harrison G Zhang
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Xin Xiong
- Department of Biostatistics, Harvard T. H. Chan School of Public Health, Boston, MA, USA
| | - Chuan Hong
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Griffin M Weber
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Gabriel A Brat
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Clara-Lea Bonzel
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Yuan Luo
- Department of Preventive Medicine Northwestern University, Chicago, IL, USA
| | - Rui Duan
- Department of Biostatistics, Harvard University, Boston, MA, USA
| | - Nathan P Palmer
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Meghan R Hutch
- Department of Preventive Medicine Northwestern University, Chicago, IL, USA
| | | | - Riccardo Bellazzi
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Luca Chiovato
- Unit of Internal Medicine and Endocrinology, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Italy
| | - Kelly Cho
- Population Health and Data Science, VA Boston Healthcare System, Boston, MA, USA; Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), VA Boston Healthcare System, Boston, MA, USA
| | - Arianna Dagliati
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Hossein Estiri
- Department of Medicine, Massachusetts General Hospital, Boston, MA, USA
| | | | - Romain Griffier
- IAM unit, Bordeaux University Hospital, Bordeaux, France; INSERM Bordeaux Population Health ERIAS TEAM, ERIAS - Inserm U1219 BPH, Bordeaux, France
| | - David A Hanauer
- Department of Learning Health Sciences, University of Michigan, Ann Arbor, MI, USA
| | - Yuk-Lam Ho
- Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), VA Boston Healthcare System, Boston, MA, USA
| | - John H Holmes
- Department of Biostatistics, Epidemiology, and Informatics University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
| | - Mark S Keller
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | | | - Sehi L'Yi
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Sara Lozano-Zahonero
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
| | - Sarah E Maidlow
- Michigan Institute for Clinical and Health Research (MICHR) Informatics, University of Michigan, Ann Arbor, MI, USA
| | - Adeline Makoudjou
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
| | - Alberto Malovini
- Laboratory of Informatics and Systems Engineering for Clinical Research, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Italy
| | - Bertrand Moal
- IAM unit, Bordeaux University Hospital, Bordeaux, France
| | - Jason H Moore
- Department of Computational Biomedicine, Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Michele Morris
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, PA, USA
| | - Danielle L Mowery
- Department of Biostatistics, Epidemiology, and Informatics University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
| | - Shawn N Murphy
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Antoine Neuraz
- Department of biomedical informatics, Hôpital Necker-Enfants Malade, Assistance Publique Hôpitaux de Paris (APHP), University of Paris, Paris, France
| | - Kee Yuan Ngiam
- Department of Biomedical informatics, WiSDM, National University Health Systems, Singapore
| | - Gilbert S Omenn
- Depts of Computational Medicine & Bioinformatics, Internal Medicine, Human Genetics, Public Health University of Michigan, Ann Arbor, MI, USA
| | - Lav P Patel
- Department of Internal Medicine, Division of Medical Informatics, University Of Kansas Medical Center
| | | | - Andrea Prunotto
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
| | | | | | - Emily R Schriver
- Data Analytics Center, University of Pennsylvania Health System, Philadelphia, PA, USA
| | - Petra Schubert
- Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), VA Boston Healthcare System, Boston, MA, USA
| | | | - Andrew M South
- Department of Pediatrics-Section of Nephrology, Brenner Children's, Wake Forest School of Medicine, Winston Salem, NC, USA
| | - Amelia L M Tan
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Byorn W L Tan
- Department of Medicine, National University Hospital, Singapore
| | - Valentina Tibollo
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
| | - Patric Tippmann
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
| | - Shyam Visweswaran
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, PA, USA
| | - Zongqi Xia
- Department of Neurology, University of Pittsburgh, Pittsburgh, PA, USA
| | - William Yuan
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Daniela Zöller
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
| | - Isaac S Kohane
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Paul Avillach
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Zijian Guo
- Department of Statistics, Rutgers, The State University of New Jersey, Piscataway, NJ, USA
| | - Tianxi Cai
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
14
|
Zhou D, Gan Z, Shi X, Patwari A, Rush E, Bonzel CL, Panickan VA, Hong C, Ho YL, Cai T, Costa L, Li X, Castro VM, Murphy SN, Brat G, Weber G, Avillach P, Gaziano JM, Cho K, Liao KP, Lu J, Cai T. Multiview Incomplete Knowledge Graph Integration with application to cross-institutional EHR data harmonization. J Biomed Inform 2022; 133:104147. [PMID: 35872266 DOI: 10.1016/j.jbi.2022.104147] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2022] [Revised: 07/05/2022] [Accepted: 07/15/2022] [Indexed: 11/26/2022]
Abstract
OBJECTIVE The growing availability of electronic health records (EHR) data opens opportunities for integrative analysis of multi-institutional EHR to produce generalizable knowledge. A key barrier to such integrative analyses is the lack of semantic interoperability across different institutions due to coding differences. We propose a Multiview Incomplete Knowledge Graph Integration (MIKGI) algorithm to integrate information from multiple sources with partially overlapping EHR concept codes to enable translations between healthcare systems. METHODS The MIKGI algorithm combines knowledge graph information from (i) embeddings trained from the co-occurrence patterns of medical codes within each EHR system and (ii) semantic embeddings of the textual strings of all medical codes obtained from the Self-Aligning Pretrained BERT (SAPBERT) algorithm. Due to the heterogeneity in the coding across healthcare systems, each EHR source provides partial coverage of the available codes. MIKGI synthesizes the incomplete knowledge graphs derived from these multi-source embeddings by minimizing a spherical loss function that combines the pairwise directional similarities of embeddings computed from all available sources. MIKGI outputs harmonized semantic embedding vectors for all EHR codes, which improves the quality of the embeddings and enables direct assessment of both similarity and relatedness between any pair of codes from multiple healthcare systems. RESULTS With EHR co-occurrence data from Veteran Affairs (VA) healthcare and Mass General Brigham (MGB), MIKGI algorithm produces high quality embeddings for a variety of downstream tasks including detecting known similar or related entity pairs and mapping VA local codes to the relevant EHR codes used at MGB. Based on the cosine similarity of the MIKGI trained embeddings, the AUC was 0.918 for detecting similar entity pairs and 0.809 for detecting related pairs. For cross-institutional medical code mapping, the top 1 and top 5 accuracy were 91.0% and 97.5% when mapping medication codes at VA to RxNorm medication codes at MGB; 59.1% and 75.8% when mapping VA local laboratory codes to LOINC hierarchy. When trained with 500 labels, the lab code mapping attained top 1 and 5 accuracy at 77.7% and 87.9%. MIKGI also attained best performance in selecting VA local lab codes for desired laboratory tests and COVID-19 related features for COVID EHR studies. Compared to existing methods, MIKGI attained the most robust performance with accuracy the highest or near the highest across all tasks. CONCLUSIONS The proposed MIKGI algorithm can effectively integrate incomplete summary data from biomedical text and EHR data to generate harmonized embeddings for EHR codes for knowledge graph modeling and cross-institutional translation of EHR codes.
Collapse
Affiliation(s)
| | | | - Xu Shi
- University of Michigan, MI, USA
| | | | - Everett Rush
- Department of Energy, Oak Ridge National Lab, Oak Ridge, TN, USA
| | - Clara-Lea Bonzel
- Harvard Medical School, Boston, MA, USA; VA Boston Healthcare System, Boston, MA, USA
| | - Vidul A Panickan
- Harvard Medical School, Boston, MA, USA; VA Boston Healthcare System, Boston, MA, USA
| | - Chuan Hong
- VA Boston Healthcare System, Boston, MA, USA; Duke University, Durham, NC, USA
| | - Yuk-Lam Ho
- VA Boston Healthcare System, Boston, MA, USA
| | - Tianrun Cai
- VA Boston Healthcare System, Boston, MA, USA; Brigham and Women's Hospital, Boston, MA, USA
| | | | | | | | | | - Gabriel Brat
- Harvard Medical School, Boston, MA, USA; Beth Israel Deaconess Medical Center, Boston, MA, USA
| | | | | | - J Michael Gaziano
- Harvard Medical School, Boston, MA, USA; VA Boston Healthcare System, Boston, MA, USA; Brigham and Women's Hospital, Boston, MA, USA
| | - Kelly Cho
- Harvard Medical School, Boston, MA, USA; VA Boston Healthcare System, Boston, MA, USA; Brigham and Women's Hospital, Boston, MA, USA
| | - Katherine P Liao
- VA Boston Healthcare System, Boston, MA, USA; Brigham and Women's Hospital, Boston, MA, USA
| | - Junwei Lu
- VA Boston Healthcare System, Boston, MA, USA; Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Tianxi Cai
- Harvard Medical School, Boston, MA, USA; VA Boston Healthcare System, Boston, MA, USA; Harvard T.H. Chan School of Public Health, Boston, MA, USA.
| |
Collapse
|
15
|
Zhang HG, Dagliati A, Shakeri Hossein Abad Z, Xiong X, Bonzel CL, Xia Z, Tan BWQ, Avillach P, Brat GA, Hong C, Morris M, Visweswaran S, Patel LP, Gutiérrez-Sacristán A, Hanauer DA, Holmes JH, Samayamuthu MJ, Bourgeois FT, L'Yi S, Maidlow SE, Moal B, Murphy SN, Strasser ZH, Neuraz A, Ngiam KY, Loh NHW, Omenn GS, Prunotto A, Dalvin LA, Klann JG, Schubert P, Vidorreta FJS, Benoit V, Verdy G, Kavuluru R, Estiri H, Luo Y, Malovini A, Tibollo V, Bellazzi R, Cho K, Ho YL, Tan ALM, Tan BWL, Gehlenborg N, Lozano-Zahonero S, Jouhet V, Chiovato L, Aronow BJ, Toh EMS, Wong WGS, Pizzimenti S, Wagholikar KB, Bucalo M, Cai T, South AM, Kohane IS, Weber GM. International electronic health record-derived post-acute sequelae profiles of COVID-19 patients. NPJ Digit Med 2022; 5:81. [PMID: 35768548 PMCID: PMC9242995 DOI: 10.1038/s41746-022-00623-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2022] [Accepted: 05/19/2022] [Indexed: 11/10/2022] Open
Abstract
The risk profiles of post-acute sequelae of COVID-19 (PASC) have not been well characterized in multi-national settings with appropriate controls. We leveraged electronic health record (EHR) data from 277 international hospitals representing 414,602 patients with COVID-19, 2.3 million control patients without COVID-19 in the inpatient and outpatient settings, and over 221 million diagnosis codes to systematically identify new-onset conditions enriched among patients with COVID-19 during the post-acute period. Compared to inpatient controls, inpatient COVID-19 cases were at significant risk for angina pectoris (RR 1.30, 95% CI 1.09–1.55), heart failure (RR 1.22, 95% CI 1.10–1.35), cognitive dysfunctions (RR 1.18, 95% CI 1.07–1.31), and fatigue (RR 1.18, 95% CI 1.07–1.30). Relative to outpatient controls, outpatient COVID-19 cases were at risk for pulmonary embolism (RR 2.10, 95% CI 1.58–2.76), venous embolism (RR 1.34, 95% CI 1.17–1.54), atrial fibrillation (RR 1.30, 95% CI 1.13–1.50), type 2 diabetes (RR 1.26, 95% CI 1.16–1.36) and vitamin D deficiency (RR 1.19, 95% CI 1.09–1.30). Outpatient COVID-19 cases were also at risk for loss of smell and taste (RR 2.42, 95% CI 1.90–3.06), inflammatory neuropathy (RR 1.66, 95% CI 1.21–2.27), and cognitive dysfunction (RR 1.18, 95% CI 1.04–1.33). The incidence of post-acute cardiovascular and pulmonary conditions decreased across time among inpatient cases while the incidence of cardiovascular, digestive, and metabolic conditions increased among outpatient cases. Our study, based on a federated international network, systematically identified robust conditions associated with PASC compared to control groups, underscoring the multifaceted cardiovascular and neurological phenotype profiles of PASC.
Collapse
Affiliation(s)
- Harrison G Zhang
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Arianna Dagliati
- Department of Electrical Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | | | - Xin Xiong
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Clara-Lea Bonzel
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Zongqi Xia
- Department of Neurology, University of Pittsburgh, Pittsburgh, PA, USA
| | - Bryce W Q Tan
- Department of Medicine, National University Hospital, Singapore, Singapore
| | - Paul Avillach
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Gabriel A Brat
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Chuan Hong
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA.,Department of Biostatistics and Bioinformatics, Duke University, Durham, NC, USA
| | - Michele Morris
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, PA, USA
| | - Shyam Visweswaran
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, PA, USA
| | - Lav P Patel
- Department of Internal Medicine, Division of Medical Informatics, University Of Kansas Medical Center, Kansas City, MO, USA
| | | | - David A Hanauer
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, MI, USA
| | - John H Holmes
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA.,Institute for Biomedical Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
| | | | | | - Sehi L'Yi
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Sarah E Maidlow
- Michigan Institute for Clinical and Health Research (MICHR) Informatics, University of Michigan, Ann Arbor, MI, USA
| | - Bertrand Moal
- IAM unit, Bordeaux University Hospital, Bordeaux, France
| | - Shawn N Murphy
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | | | - Antoine Neuraz
- Department of biomedical informatics, Hôpital Necker-Enfants Malade, Assistance Publique Hôpitaux de Paris (APHP), University of Paris, Paris, France
| | - Kee Yuan Ngiam
- Department of Biomedical informatics, WiSDM, National University Health Systems Singapore, Singapore, Singapore
| | - Ne Hooi Will Loh
- Department of Anaesthesia, National University Health Systems Singapore, Singapore, Singapore
| | - Gilbert S Omenn
- Department of Computational Medicine & Bioinformatics, Internal Medicine, Human Genetics, and School of Public Health, University of Michigan, Ann Arbor, MI, USA
| | - Andrea Prunotto
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
| | - Lauren A Dalvin
- Department of Ophthalmology, Mayo Clinic, Rochester, NY, USA
| | - Jeffrey G Klann
- Department of Medicine, Massachusetts General Hospital, Boston, MA, USA
| | - Petra Schubert
- Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), VA Boston Healthcare System, Boston, MA, USA
| | | | - Vincent Benoit
- IT Department, Innovation & Data, APHP Greater Paris University Hospital, Paris, France
| | | | - Ramakanth Kavuluru
- Division of Biomedical Informatics (Department of Internal Medicine), University of Kentucky, Lexington, KY, USA
| | - Hossein Estiri
- Department of Medicine, Massachusetts General Hospital, Boston, MA, USA
| | - Yuan Luo
- Department of Preventive Medicine, Northwestern University, Chicago, IL, USA
| | - Alberto Malovini
- Laboratory of Informatics and Systems Engineering for Clinical Research, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Italy
| | - Valentina Tibollo
- Laboratory of Informatics and Systems Engineering for Clinical Research, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Italy
| | - Riccardo Bellazzi
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Kelly Cho
- Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), VA Boston Healthcare System, Boston, MA, USA.,Population Health and Data Science, VA Boston Healthcare System, Boston, MA, USA
| | - Yuk-Lam Ho
- Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), VA Boston Healthcare System, Boston, MA, USA
| | - Amelia L M Tan
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Byorn W L Tan
- Department of Medicine, National University Hospital, Singapore, Singapore
| | - Nils Gehlenborg
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Sara Lozano-Zahonero
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
| | - Vianney Jouhet
- IAM unit, INSERM Bordeaux Population Health ERIAS TEAM, Bordeaux University Hospital / ERIAS - Inserm, U1219 BPH, Bordeaux, France
| | - Luca Chiovato
- Unit of Internal Medicine and Endocrinology, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Italy
| | - Bruce J Aronow
- Departments of Biomedical Informatics, Pediatrics, Cincinnati Children's Hospital Medical Center, University of Cincinnati, Cincinnati, OH, USA
| | - Emma M S Toh
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Wei Gen Scott Wong
- Department of Medicine, National University Health Systems Singapore, Singapore, Singapore
| | - Sara Pizzimenti
- Scientific Direction, IRCCS Ca' Granda Ospedale Maggiore Policlinico di Milano, Milan, Italy
| | | | - Mauro Bucalo
- BIOMERIS (BIOMedical Research Informatics Solutions), Pavia, Italy
| | | | - Tianxi Cai
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Andrew M South
- Department of Pediatrics-Section of Nephrology, Brenner Children's, Wake Forest School of Medicine, Winston Salem, NC, USA
| | - Isaac S Kohane
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Griffin M Weber
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA.
| |
Collapse
|
16
|
Hong C, Zhang HG, L'Yi S, Weber G, Avillach P, Tan BWQ, Gutiérrez-Sacristán A, Bonzel CL, Palmer NP, Malovini A, Tibollo V, Luo Y, Hutch MR, Liu M, Bourgeois F, Bellazzi R, Chiovato L, Sanz Vidorreta FJ, Le TT, Wang X, Yuan W, Neuraz A, Benoit V, Moal B, Morris M, Hanauer DA, Maidlow S, Wagholikar K, Murphy S, Estiri H, Makoudjou A, Tippmann P, Klann J, Follett RW, Gehlenborg N, Omenn GS, Xia Z, Dagliati A, Visweswaran S, Patel LP, Mowery DL, Schriver ER, Samayamuthu MJ, Kavuluru R, Lozano-Zahonero S, Zöller D, Tan ALM, Tan BWL, Ngiam KY, Holmes JH, Schubert P, Cho K, Ho YL, Beaulieu-Jones BK, Pedrera-Jiménez M, García-Barrio N, Serrano-Balazote P, Kohane I, South A, Brat GA, Cai T. Changes in laboratory value improvement and mortality rates over the course of the pandemic: an international retrospective cohort study of hospitalised patients infected with SARS-CoV-2. BMJ Open 2022; 12:e057725. [PMID: 35738646 PMCID: PMC9226470 DOI: 10.1136/bmjopen-2021-057725] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Accepted: 06/12/2022] [Indexed: 01/08/2023] Open
Abstract
OBJECTIVE To assess changes in international mortality rates and laboratory recovery rates during hospitalisation for patients hospitalised with SARS-CoV-2 between the first wave (1 March to 30 June 2020) and the second wave (1 July 2020 to 31 January 2021) of the COVID-19 pandemic. DESIGN, SETTING AND PARTICIPANTS This is a retrospective cohort study of 83 178 hospitalised patients admitted between 7 days before or 14 days after PCR-confirmed SARS-CoV-2 infection within the Consortium for Clinical Characterization of COVID-19 by Electronic Health Record, an international multihealthcare system collaborative of 288 hospitals in the USA and Europe. The laboratory recovery rates and mortality rates over time were compared between the two waves of the pandemic. PRIMARY AND SECONDARY OUTCOME MEASURES The primary outcome was all-cause mortality rate within 28 days after hospitalisation stratified by predicted low, medium and high mortality risk at baseline. The secondary outcome was the average rate of change in laboratory values during the first week of hospitalisation. RESULTS Baseline Charlson Comorbidity Index and laboratory values at admission were not significantly different between the first and second waves. The improvement in laboratory values over time was faster in the second wave compared with the first. The average C reactive protein rate of change was -4.72 mg/dL vs -4.14 mg/dL per day (p=0.05). The mortality rates within each risk category significantly decreased over time, with the most substantial decrease in the high-risk group (42.3% in March-April 2020 vs 30.8% in November 2020 to January 2021, p<0.001) and a moderate decrease in the intermediate-risk group (21.5% in March-April 2020 vs 14.3% in November 2020 to January 2021, p<0.001). CONCLUSIONS Admission profiles of patients hospitalised with SARS-CoV-2 infection did not differ greatly between the first and second waves of the pandemic, but there were notable differences in laboratory improvement rates during hospitalisation. Mortality risks among patients with similar risk profiles decreased over the course of the pandemic. The improvement in laboratory values and mortality risk was consistent across multiple countries.
Collapse
Affiliation(s)
- Chuan Hong
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
| | - Harrison G Zhang
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
| | - Sehi L'Yi
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
| | - Griffin Weber
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
| | - Paul Avillach
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
| | - Bryce W Q Tan
- Department of Medicine, National University Hospital, Singapore
| | | | - Clara-Lea Bonzel
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
| | - Nathan P Palmer
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
| | - Alberto Malovini
- Laboratory of Informatics and Systems Engineering for Clinical Research, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Lombardia, Italy
| | - Valentina Tibollo
- Laboratory of Informatics and Systems Engineering for Clinical Research, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Lombardia, Italy
| | - Yuan Luo
- Department of Preventive Medicine, Northwestern University, Evanston, Illinois, USA
| | - Meghan R Hutch
- Department of Preventive Medicine, Northwestern University, Evanston, Illinois, USA
| | - Molei Liu
- Department of Biostatistics, Harvard University T H Chan School of Public Health, Boston, Massachusetts, USA
| | - Florence Bourgeois
- Department of Pediatrics, Harvard Medical School, Boston, Massachusetts, USA
| | - Riccardo Bellazzi
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Luca Chiovato
- Unit of Internal Medicine and Endocrinology, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Lombardia, Italy
| | | | - Trang T Le
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA
| | - Xuan Wang
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
| | - William Yuan
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
| | - Antoine Neuraz
- Department of Biomedical Informatics, Hopital Universitaire Necker-Enfants Malades, Paris, Île-de-France, France
| | - Vincent Benoit
- IT department, Innovation & Data, APHP Greater Paris University Hospital, Paris, France
| | - Bertrand Moal
- IAM unit, Bordeaux University Hospital, Bordeaux, France
| | - Michele Morris
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | - David A Hanauer
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, Michigan, USA
| | - Sarah Maidlow
- MICHR Informatics, University of Michigan, Ann Arbor, Michigan, USA
| | - Kavishwar Wagholikar
- Department of Medicine, Massachusetts General Hospital, Boston, Massachusetts, USA
| | - Shawn Murphy
- Neurology, Massachusetts General Hospital, Boston, Massachusetts, USA
| | - Hossein Estiri
- Department of Medicine, Massachusetts General Hospital, Boston, Massachusetts, USA
| | - Adeline Makoudjou
- Institute of Medical Biometry and Statistics, University of Freiburg Faculty of Medicine, Freiburg, Baden-Württemberg, Germany
| | - Patric Tippmann
- Institute of Medical Biometry and Statistics, Medical Center-University of Freiburg, Freiburg, Baden-Württemberg, Germany
| | - Jeffery Klann
- Department of Medicine, Massachusetts General Hospital, Boston, Massachusetts, USA
| | - Robert W Follett
- Department of Medicine, David Geffen School of Medicine, Los Angeles, California, USA
| | - Nils Gehlenborg
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
| | - Gilbert S Omenn
- Computational Medicine & Bioinformatics, University of Michigan, Ann Arbor, Michigan, USA
| | - Zongqi Xia
- Department of Neurology, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | - Arianna Dagliati
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Shyam Visweswaran
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, Kansas, USA
| | - Lav P Patel
- Department of Internal Medicine, Division of Medical Informatics, University of Kansas Medical Center, Kansas City, Kansas, USA
| | - Danielle L Mowery
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA
| | - Emily R Schriver
- Data Analytics Center, University of Pennsylvania Health System, Philadelphia, Pennsylvania, USA
| | | | - Ramakanth Kavuluru
- Institute for Biomedical Informatics, University of Kentucky, Lexington, Kentucky, USA
| | - Sara Lozano-Zahonero
- Institute of Medical Biometry and Statistics, University of Freiburg Faculty of Medicine, Freiburg, Baden-Württemberg, Germany
| | - Daniela Zöller
- Institute of Medical Biometry and Statistics, University of Freiburg Faculty of Medicine, Freiburg, Baden-Württemberg, Germany
| | - Amelia L M Tan
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
| | - Byorn W L Tan
- Department of Medicine, National University Hospital, Singapore
| | - Kee Yuan Ngiam
- Department of Surgery, National University Hospital, Singapore
| | - John H Holmes
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA
- Institute for Biomedical Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA
| | - Petra Schubert
- Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), VA Boston Healthcare System, Boston, Massachusetts, USA
| | - Kelly Cho
- Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), VA Boston Healthcare System, Boston, Massachusetts, USA
| | - Yuk-Lam Ho
- Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), VA Boston Healthcare System, Boston, Massachusetts, USA
| | | | - Miguel Pedrera-Jiménez
- Health Informatics, Hospital Universitario 12 de Octubre, Madrid, Comunidad de Madrid, Spain
| | - Noelia García-Barrio
- Health Informatics, Hospital Universitario 12 de Octubre, Madrid, Comunidad de Madrid, Spain
| | - Pablo Serrano-Balazote
- Health Informatics, Hospital Universitario 12 de Octubre, Madrid, Comunidad de Madrid, Spain
| | - Isaac Kohane
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
| | - Andrew South
- Department of Pediatrics, Section of Nephrology, Wake Forest University, Winston Salem, North Carolina, USA
| | - Gabriel A Brat
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
| | - T Cai
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
17
|
Weber GM, Hong C, Xia Z, Palmer NP, Avillach P, L'Yi S, Keller MS, Murphy SN, Gutiérrez-Sacristán A, Bonzel CL, Serret-Larmande A, Neuraz A, Omenn GS, Visweswaran S, Klann JG, South AM, Loh NHW, Cannataro M, Beaulieu-Jones BK, Bellazzi R, Agapito G, Alessiani M, Aronow BJ, Bell DS, Benoit V, Bourgeois FT, Chiovato L, Cho K, Dagliati A, DuVall SL, Barrio NG, Hanauer DA, Ho YL, Holmes JH, Issitt RW, Liu M, Luo Y, Lynch KE, Maidlow SE, Malovini A, Mandl KD, Mao C, Matheny ME, Moore JH, Morris JS, Morris M, Mowery DL, Ngiam KY, Patel LP, Pedrera-Jimenez M, Ramoni RB, Schriver ER, Schubert P, Balazote PS, Spiridou A, Tan ALM, Tan BWL, Tibollo V, Torti C, Trecarichi EM, Wang X, Kohane IS, Cai T, Brat GA. International comparisons of laboratory values from the 4CE collaborative to predict COVID-19 mortality. NPJ Digit Med 2022; 5:74. [PMID: 35697747 PMCID: PMC9192605 DOI: 10.1038/s41746-022-00601-0] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2021] [Accepted: 03/11/2022] [Indexed: 01/08/2023] Open
Abstract
Given the growing number of prediction algorithms developed to predict COVID-19 mortality, we evaluated the transportability of a mortality prediction algorithm using a multi-national network of healthcare systems. We predicted COVID-19 mortality using baseline commonly measured laboratory values and standard demographic and clinical covariates across healthcare systems, countries, and continents. Specifically, we trained a Cox regression model with nine measured laboratory test values, standard demographics at admission, and comorbidity burden pre-admission. These models were compared at site, country, and continent level. Of the 39,969 hospitalized patients with COVID-19 (68.6% male), 5717 (14.3%) died. In the Cox model, age, albumin, AST, creatine, CRP, and white blood cell count are most predictive of mortality. The baseline covariates are more predictive of mortality during the early days of COVID-19 hospitalization. Models trained at healthcare systems with larger cohort size largely retain good transportability performance when porting to different sites. The combination of routine laboratory test values at admission along with basic demographic features can predict mortality in patients hospitalized with COVID-19. Importantly, this potentially deployable model differs from prior work by demonstrating not only consistent performance but also reliable transportability across healthcare systems in the US and Europe, highlighting the generalizability of this model and the overall approach.
Collapse
Affiliation(s)
- Griffin M Weber
- Department of Biomedical Informatics, Harvard Medical School, Boston, USA
| | - Chuan Hong
- Department of Biomedical Informatics, Harvard Medical School, Boston, USA
- Department of Biostatistics and Bioinformatics, Duke University, Durham, USA
| | - Zongqi Xia
- Department of Neurology, University of Pittsburgh, Pittsburgh, USA
| | - Nathan P Palmer
- Department of Biomedical Informatics, Harvard Medical School, Boston, USA
| | - Paul Avillach
- Department of Biomedical Informatics, Harvard Medical School, Boston, USA
| | - Sehi L'Yi
- Department of Biomedical Informatics, Harvard Medical School, Boston, USA
| | - Mark S Keller
- Department of Biomedical Informatics, Harvard Medical School, Boston, USA
| | - Shawn N Murphy
- Department of Neurology, Massachusetts General Hospital, Boston, USA
| | | | - Clara-Lea Bonzel
- Department of Biomedical Informatics, Harvard Medical School, Boston, USA
| | - Arnaud Serret-Larmande
- Department of biomedical informatics, Hôpital Européen Georges Pompidou, Assistance Publique - Hôpitaux de Paris, Paris, France
| | - Antoine Neuraz
- Department of biomedical informatics, Hôpital Necker-Enfants Malade, Assistance Publique Hôpitaux de Paris (APHP), University of Paris, Paris, France
| | - Gilbert S Omenn
- Department of Computational Medicine & Bioinformatics, Internal Medicine, Human Genetics, and School of Public Health, University of Michigan, Ann Arbor, USA
| | - Shyam Visweswaran
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, USA
| | - Jeffrey G Klann
- Department of Medicine, Massachusetts General Hospital, Boston, USA
| | - Andrew M South
- Department of Pediatrics-Section of Nephrology, Brenner Children's Hospital, Wake Forest School of Medicine, Winston Salem, USA
| | - Ne Hooi Will Loh
- Department of Anaesthesia, National University Health System, Singapore, Singapore, Singapore
| | - Mario Cannataro
- Department of Medical and Surgical Sciences, Data Analytics Research Center, University Magna Graecia of Catanzaro, Italy, Catanzaro, Italy
| | | | - Riccardo Bellazzi
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Italy, Pavia, Italy
| | - Giuseppe Agapito
- Department of Legal, Economic and Social Sciences, University Magna Graecia of Catanzaro, Italy, Catanzaro, Italy
| | - Mario Alessiani
- Department of Surgery, ASST Pavia, Lombardia Region Health System, Pavia, Italy
| | - Bruce J Aronow
- Departments of Biomedical Informatics, Pediatrics, Cincinnati Children's Hospital Medical Center, University of Cincinnati, Cincinnati, USA
| | - Douglas S Bell
- Department of Medicine, David Geffen School of Medicine at UCLA, Los Angeles, USA
| | - Vincent Benoit
- IT department, Innovation & Data, APHP Greater Paris University Hospital, Paris, France
| | | | - Luca Chiovato
- Unit of Internal Medicine and Endocrinology, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Italy
| | - Kelly Cho
- Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), VA Boston Healthcare System, Boston, USA
| | - Arianna Dagliati
- Department of Electrical Computer and Biomedical Engineering, University of Pavia, Italy, Pavia, Italy
| | - Scott L DuVall
- VA Informatics and Computing Infrastructure, VA Salt Lake City Health Care System, Salt Lake City, USA
| | | | - David A Hanauer
- Department of Learning Health Sciences, University of Michigan, Ann Arbor, USA
| | - Yuk-Lam Ho
- Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), VA Boston Healthcare System, Boston, USA
| | - John H Holmes
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, USA
- Institute for Biomedical Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, USA
| | - Richard W Issitt
- Digital Research, Informatics and Virtual Environments (DRIVE), Great Ormond Street Hospital for Children, UK, London, UK
| | - Molei Liu
- Department of Biostatistics, Harvard School of Public Health, Boston, USA
| | - Yuan Luo
- Department of Preventive Medicine, Northwestern University, Chicago, USA
| | - Kristine E Lynch
- VA Informatics and Computing Infrastructure, VA Salt Lake City Health Care System, Salt Lake City, USA
| | - Sarah E Maidlow
- Michigan Institute for Clinical and Health Research, University of Michigan, Ann Arbor, USA
| | - Alberto Malovini
- Laboratory of Informatics and Systems Engineering for Clinical Research, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Italy
| | - Kenneth D Mandl
- Computational Health Informatics Program, Boston Children's Hospital, Boston, USA
| | - Chengsheng Mao
- Department of Preventive Medicine, Northwestern University, Chicago, USA
| | - Michael E Matheny
- VA Informatics and Computing Infrastructure, Tennessee Valley Healthcare System Veterans Affairs Medical Center, Nashville, USA
| | - Jason H Moore
- Institute for Biomedical Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, USA
| | - Jeffrey S Morris
- Department of Biostatistics, Epidemiology, and Biostatistics, University of Pennysylvania Perelman School of Medicine, Philadelphia, USA
| | - Michele Morris
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, USA
| | - Danielle L Mowery
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, USA
| | - Kee Yuan Ngiam
- Department of Biomedical informatics, WiSDM, National University Health Systems Singapore, Singapore, Singapore
| | - Lav P Patel
- Department of Internal Medicine, Division of Medical Informatics, University of Kansas Medical Center, Kansas City, USA
| | | | - Rachel B Ramoni
- Office of Research and Development, Department of Veterans Affairs, Washington, DC, USA
| | - Emily R Schriver
- Data Analytics Center, University of Pennsylvania Health System, Philadelphia, USA
| | - Petra Schubert
- Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), VA Boston Healthcare System, Boston, USA
| | | | - Anastasia Spiridou
- Digital Research, Informatics and Virtual Environments (DRIVE), Great Ormond Street Hospital for Children, UK, London, UK
| | - Amelia L M Tan
- Department of Biomedical Informatics, Harvard Medical School, Boston, USA
| | - Byorn W L Tan
- Department of Medicine, National University Hospital, Singapore, Singapore, Singapore
| | - Valentina Tibollo
- Laboratory of Informatics and Systems Engineering for Clinical Research, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Italy
| | - Carlo Torti
- Department of Medical and Surgical Sciences, Infectious and Tropical Disease Unit, University Magna Graecia of Catanzaro, Italy, Catanzaro, Italy
| | - Enrico M Trecarichi
- Department of Medical and Surgical Sciences, Infectious and Tropical Disease Unit, University Magna Graecia of Catanzaro, Italy, Catanzaro, Italy
| | - Xuan Wang
- Department of Biomedical Informatics, Harvard Medical School, Boston, USA
| | - Isaac S Kohane
- Department of Biomedical Informatics, Harvard Medical School, Boston, USA
| | - Tianxi Cai
- Department of Biomedical Informatics, Harvard Medical School, Boston, USA.
| | - Gabriel A Brat
- Department of Biomedical Informatics, Harvard Medical School, Boston, USA.
| |
Collapse
|
18
|
Hou J, Zhao R, Cai T, Beaulieu-Jones B, Seyok T, Dahal K, Yuan Q, Xiong X, Bonzel CL, Fox C, Christiani DC, Jemielita T, Liao KP, Liaw KL, Cai T. Temporal Trends in Clinical Evidence of 5-Year Survival Within Electronic Health Records Among Patients With Early-Stage Colon Cancer Managed With Laparoscopy-Assisted Colectomy vs Open Colectomy. JAMA Netw Open 2022; 5:e2218371. [PMID: 35737384 PMCID: PMC9227003 DOI: 10.1001/jamanetworkopen.2022.18371] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
IMPORTANCE Temporal shifts in clinical knowledge and practice need to be adjusted for in treatment outcome assessment in clinical evidence. OBJECTIVE To use electronic health record (EHR) data to (1) assess the temporal trends in treatment decisions and patient outcomes and (2) emulate a randomized clinical trial (RCT) using EHR data with proper adjustment for temporal trends. DESIGN, SETTING, AND PARTICIPANTS The Clinical Outcomes of Surgical Therapy (COST) Study Group Trial assessing overall survival of patients with stages I to III early-stage colon cancer was chosen as the target trial. The RCT was emulated using EHR data of patients from a single health care system cohort who underwent colectomy for early-stage colon cancer from January 1, 2006, to December 31, 2017, and were followed up to January 1, 2020, from Mass General Brigham. Analyses were conducted from December 2, 2019, to January 24, 2022. EXPOSURES Laparoscopy-assisted colectomy (LAC) vs open colectomy (OC). MAIN OUTCOMES AND MEASURES The primary outcome was 5-year overall survival. To address confounding in the emulation, pretreatment variables were selected and adjusted. The temporal trends were adjusted by stratification of the calendar year when the colectomies were performed with cotraining across strata. RESULTS A total of 943 patients met key RCT eligibility criteria in the EHR emulation cohort, including 518 undergoing LAC (median age, 63 [range, 20-95] years; 268 [52%] women; 121 [23%] with stage I, 165 [32%] with stage II, and 232 [45%] with stage III cancer; 32 [6%] with colon adhesion; 278 [54%] with right-sided colon cancer; 18 [3%] with left-sided colon cancer; and 222 [43%] with sigmoid colon cancer) and 425 undergoing OC (median age, 65 [range, 28-99] years; 223 [52%] women; 61 [14%] with stage I, 153 [36%] with stage II, and 211 [50%] with stage III cancer; 39 [9%] with colon adhesion; 202 [47%] with right-sided colon cancer; 39 [9%] with left-sided colon cancer; and 201 [47%] with sigmoid colon cancer). Tests for temporal trends in treatment assignment (χ2 = 60.3; P < .001) and overall survival (χ2 = 137.2; P < .001) were significant. The adjusted EHR emulation reached the same conclusion as the RCT: LAC is not inferior to OC in overall survival rate with risk difference at 5 years of -0.007 (95% CI, -0.070 to 0.057). The results were consistent for stratified analysis within each temporal period. CONCLUSIONS AND RELEVANCE These findings suggest that confounding bias from temporal trends should be considered when conducting clinical evidence studies with long time spans. Stratification of calendar time and cotraining of models is one solution. With proper adjustment, clinical evidence may supplement RCTs in the assessment of treatment outcome over time.
Collapse
Affiliation(s)
- Jue Hou
- Department of Biostatistics, Harvard T. H. Chan School of Public Health, Boston, Massachusetts
| | - Rachel Zhao
- Department of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| | - Tianrun Cai
- Division of Rheumatology, Inflammation, and Immunity, Department of Medicine, Brigham and Women’s Hospital/Harvard Medical School, Boston, Massachusetts
| | - Brett Beaulieu-Jones
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
| | - Thany Seyok
- Division of Rheumatology, Inflammation, and Immunity, Department of Medicine, Brigham and Women’s Hospital/Harvard Medical School, Boston, Massachusetts
| | - Kumar Dahal
- Division of Rheumatology, Inflammation, and Immunity, Department of Medicine, Brigham and Women’s Hospital/Harvard Medical School, Boston, Massachusetts
| | - Qianyu Yuan
- Department of Environmental Health, Harvard T. H. Chan School of Public Health, Boston, Massachusetts
| | - Xin Xiong
- Department of Biostatistics, Harvard T. H. Chan School of Public Health, Boston, Massachusetts
| | - Clara-Lea Bonzel
- Department of Biostatistics, Harvard T. H. Chan School of Public Health, Boston, Massachusetts
| | | | - David C. Christiani
- Department of Environmental Health, Harvard T. H. Chan School of Public Health, Boston, Massachusetts
| | | | - Katherine P. Liao
- Division of Rheumatology, Inflammation, and Immunity, Department of Medicine, Brigham and Women’s Hospital/Harvard Medical School, Boston, Massachusetts
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
| | | | - Tianxi Cai
- Department of Biostatistics, Harvard T. H. Chan School of Public Health, Boston, Massachusetts
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
| |
Collapse
|
19
|
Weber GM, Zhang HG, L'Yi S, Bonzel CL, Hong C, Avillach P, Gutiérrez-Sacristán A, Palmer NP, Tan ALM, Wang X, Yuan W, Gehlenborg N, Alloni A, Amendola DF, Bellasi A, Bellazzi R, Beraghi M, Bucalo M, Chiovato L, Cho K, Dagliati A, Estiri H, Follett RW, García Barrio N, Hanauer DA, Henderson DW, Ho YL, Holmes JH, Hutch MR, Kavuluru R, Kirchoff K, Klann JG, Krishnamurthy AK, Le TT, Liu M, Loh NHW, Lozano-Zahonero S, Luo Y, Maidlow S, Makoudjou A, Malovini A, Martins MR, Moal B, Morris M, Mowery DL, Murphy SN, Neuraz A, Ngiam KY, Okoshi MP, Omenn GS, Patel LP, Pedrera Jiménez M, Prudente RA, Samayamuthu MJ, Sanz Vidorreta FJ, Schriver ER, Schubert P, Serrano Balazote P, Tan BW, Tanni SE, Tibollo V, Visweswaran S, Wagholikar KB, Xia Z, Zöller D, Kohane IS, Cai T, South AM, Brat GA. Authorship Correction: International Changes in COVID-19 Clinical Trajectories Across 315 Hospitals and 6 Countries: Retrospective Cohort Study. J Med Internet Res 2021; 23:e34625. [PMID: 34889759 PMCID: PMC8672293 DOI: 10.2196/34625] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Accepted: 11/10/2021] [Indexed: 11/15/2022] Open
Affiliation(s)
- Griffin M Weber
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Harrison G Zhang
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Sehi L'Yi
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Clara-Lea Bonzel
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Chuan Hong
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Paul Avillach
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | | | - Nathan P Palmer
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Amelia Li Min Tan
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Xuan Wang
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - William Yuan
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Nils Gehlenborg
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Anna Alloni
- BIOMERIS (BIOMedical Research Informatics Solutions), Pavia, Italy
| | - Danilo F Amendola
- Clinical Research Unit, Botucatu Medical School, São Paulo State University, Botucatu, Brazil
| | - Antonio Bellasi
- Division of Nephrology, Department of Medicine, Ente Ospedaliero Cantonale, Lugano, Switzerland
| | - Riccardo Bellazzi
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Michele Beraghi
- Information Technology Department, Azienda Socio-Sanitaria Territoriale di Pavia, Pavia, Italy
| | - Mauro Bucalo
- BIOMERIS (BIOMedical Research Informatics Solutions), Pavia, Italy
| | - Luca Chiovato
- Unit of Internal Medicine and Endocrinology, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Italy
| | - Kelly Cho
- Massachusetts Veterans Epidemiology Research and Information Center, Veterans Affairs Boston Healthcare System, Boston, MA, United States
| | - Arianna Dagliati
- Department of Electrical Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Hossein Estiri
- Department of Medicine, Massachusetts General Hospital, Boston, MA, United States
| | - Robert W Follett
- Department of Medicine, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, United States
| | | | - David A Hanauer
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, MI, United States
| | - Darren W Henderson
- Department of Biomedical Informatics, University of Kentucky, Lexington, KY, United States
| | - Yuk-Lam Ho
- Massachusetts Veterans Epidemiology Research and Information Center, Veterans Affairs Boston Healthcare System, Boston, MA, United States
| | - John H Holmes
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States.,Institute for Biomedical Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States
| | - Meghan R Hutch
- Department of Preventive Medicine, Northwestern University, Chicago, IL, United States
| | - Ramakanth Kavuluru
- Institute for Biomedical Informatics, University of Kentucky, Lexington, KY, United States
| | - Katie Kirchoff
- Medical University of South Carolina, Charleston, SC, United States
| | - Jeffrey G Klann
- Department of Medicine, Massachusetts General Hospital, Boston, MA, United States
| | - Ashok K Krishnamurthy
- Department of Computer Science, Renaissance Computing Institute, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States
| | - Trang T Le
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States
| | - Molei Liu
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA, United States
| | - Ne Hooi Will Loh
- Department of Anaesthesia, National University Health System, Singapore, Singapore
| | - Sara Lozano-Zahonero
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
| | - Yuan Luo
- Department of Preventive Medicine, Northwestern University, Chicago, IL, United States
| | - Sarah Maidlow
- Michigan Institute for Clinical & Health Research Informatics, University of Michigan, Ann Arbor, MI, United States
| | - Adeline Makoudjou
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
| | - Alberto Malovini
- Laboratory of Informatics and Systems Engineering for Clinical Research, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Italy
| | | | - Bertrand Moal
- Informatique et archivistique médicales unit, Bordeaux University Hospital, Bordeaux, France
| | - Michele Morris
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, PA, United States
| | - Danielle L Mowery
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States
| | - Shawn N Murphy
- Department of Neurology, Massachusetts General Hospital, Boston, MA, United States
| | - Antoine Neuraz
- Department of Biomedical Informatics, Hôpital Necker-Enfants Malade, Assistance Publique Hôpitaux de Paris, University of Paris, Paris, France
| | - Kee Yuan Ngiam
- Department of Biomedical Informatics, Institute for Digital Medicine, National University Health System, Singapore, Singapore
| | - Marina P Okoshi
- Internal Medicine Department, Botucatu Medical School, São Paulo State University, Botucatu, Brazil
| | - Gilbert S Omenn
- Department of Computational Medicine & Bioinformatics, Internal Medicine, Human Genetics, and Public Health, University of Michigan, Ann Arbor, MI, United States
| | - Lav P Patel
- Division of Medical Informatics, Department of Internal Medicine, University of Kansas Medical Center, Kansas City, KS, United States
| | | | - Robson A Prudente
- Internal Medicine Department, Botucatu Medical School, São Paulo State University, Botucatu, Brazil
| | | | - Fernando J Sanz Vidorreta
- Department of Medicine, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, United States
| | - Emily R Schriver
- Data Analytics Center, University of Pennsylvania Health System, Philadelphia, PA, United States
| | - Petra Schubert
- Massachusetts Veterans Epidemiology Research and Information Center, Veterans Affairs Boston Healthcare System, Boston, MA, United States
| | | | - Byorn Wl Tan
- Department of Medicine, National University Health System, Singapore, Singapore
| | - Suzana E Tanni
- Internal Medicine Department, Botucatu Medical School, São Paulo State University, Botucatu, Brazil
| | - Valentina Tibollo
- Laboratory of Informatics and Systems Engineering for Clinical Research, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Italy
| | - Shyam Visweswaran
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, PA, United States
| | | | - Zongqi Xia
- Department of Neurology, University of Pittsburgh, Pittsburgh, PA, United States
| | - Daniela Zöller
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
| | -
- see Authors' Contributions,
| | - Isaac S Kohane
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Tianxi Cai
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Andrew M South
- Section of Nephrology, Department of Pediatrics, Brenner Children's Hospital, Wake Forest School of Medicine, Winston Salem, NC, United States
| | - Gabriel A Brat
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| |
Collapse
|
20
|
Weber GM, Zhang HG, L'Yi S, Bonzel CL, Hong C, Avillach P, Gutiérrez-Sacristán A, Palmer NP, Tan ALM, Wang X, Yuan W, Gehlenborg N, Alloni A, Amendola DF, Bellasi A, Bellazzi R, Beraghi M, Bucalo M, Chiovato L, Cho K, Dagliati A, Estiri H, Follett RW, García Barrio N, Hanauer DA, Henderson DW, Ho YL, Holmes JH, Hutch MR, Kavuluru R, Kirchoff K, Klann JG, Krishnamurthy AK, Le TT, Liu M, Loh NHW, Lozano-Zahonero S, Luo Y, Maidlow S, Makoudjou A, Malovini A, Martins MR, Moal B, Morris M, Mowery DL, Murphy SN, Neuraz A, Ngiam KY, Okoshi MP, Omenn GS, Patel LP, Pedrera Jiménez M, Prudente RA, Samayamuthu MJ, Sanz Vidorreta FJ, Schriver ER, Schubert P, Serrano Balazote P, Tan BW, Tanni SE, Tibollo V, Visweswaran S, Wagholikar KB, Xia Z, Zöller D, Kohane IS, Cai T, South AM, Brat GA. International Changes in COVID-19 Clinical Trajectories Across 315 Hospitals and 6 Countries: Retrospective Cohort Study. J Med Internet Res 2021; 23:e31400. [PMID: 34533459 PMCID: PMC8510151 DOI: 10.2196/31400] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2021] [Revised: 09/02/2021] [Accepted: 09/02/2021] [Indexed: 02/06/2023] Open
Abstract
Background Many countries have experienced 2 predominant waves of COVID-19–related hospitalizations. Comparing the clinical trajectories of patients hospitalized in separate waves of the pandemic enables further understanding of the evolving epidemiology, pathophysiology, and health care dynamics of the COVID-19 pandemic. Objective In this retrospective cohort study, we analyzed electronic health record (EHR) data from patients with SARS-CoV-2 infections hospitalized in participating health care systems representing 315 hospitals across 6 countries. We compared hospitalization rates, severe COVID-19 risk, and mean laboratory values between patients hospitalized during the first and second waves of the pandemic. Methods Using a federated approach, each participating health care system extracted patient-level clinical data on their first and second wave cohorts and submitted aggregated data to the central site. Data quality control steps were adopted at the central site to correct for implausible values and harmonize units. Statistical analyses were performed by computing individual health care system effect sizes and synthesizing these using random effect meta-analyses to account for heterogeneity. We focused the laboratory analysis on C-reactive protein (CRP), ferritin, fibrinogen, procalcitonin, D-dimer, and creatinine based on their reported associations with severe COVID-19. Results Data were available for 79,613 patients, of which 32,467 were hospitalized in the first wave and 47,146 in the second wave. The prevalence of male patients and patients aged 50 to 69 years decreased significantly between the first and second waves. Patients hospitalized in the second wave had a 9.9% reduction in the risk of severe COVID-19 compared to patients hospitalized in the first wave (95% CI 8.5%-11.3%). Demographic subgroup analyses indicated that patients aged 26 to 49 years and 50 to 69 years; male and female patients; and black patients had significantly lower risk for severe disease in the second wave than in the first wave. At admission, the mean values of CRP were significantly lower in the second wave than in the first wave. On the seventh hospital day, the mean values of CRP, ferritin, fibrinogen, and procalcitonin were significantly lower in the second wave than in the first wave. In general, countries exhibited variable changes in laboratory testing rates from the first to the second wave. At admission, there was a significantly higher testing rate for D-dimer in France, Germany, and Spain. Conclusions Patients hospitalized in the second wave were at significantly lower risk for severe COVID-19. This corresponded to mean laboratory values in the second wave that were more likely to be in typical physiological ranges on the seventh hospital day compared to the first wave. Our federated approach demonstrated the feasibility and power of harmonizing heterogeneous EHR data from multiple international health care systems to rapidly conduct large-scale studies to characterize how COVID-19 clinical trajectories evolve.
Collapse
Affiliation(s)
- Griffin M Weber
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Harrison G Zhang
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Sehi L'Yi
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Clara-Lea Bonzel
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Chuan Hong
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Paul Avillach
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | | | - Nathan P Palmer
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Amelia Li Min Tan
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Xuan Wang
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - William Yuan
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Nils Gehlenborg
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Anna Alloni
- BIOMERIS (BIOMedical Research Informatics Solutions), Pavia, Italy
| | - Danilo F Amendola
- Clinical Research Unit, Botucatu Medical School, São Paulo State University, Botucatu, Brazil
| | - Antonio Bellasi
- Division of Nephrology, Department of Medicine, Ente Ospedaliero Cantonale, Lugano, Switzerland
| | - Riccardo Bellazzi
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Michele Beraghi
- Information Technology Department, Azienda Socio-Sanitaria Territoriale di Pavia, Pavia, Italy
| | - Mauro Bucalo
- BIOMERIS (BIOMedical Research Informatics Solutions), Pavia, Italy
| | - Luca Chiovato
- Unit of Internal Medicine and Endocrinology, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Italy
| | - Kelly Cho
- Massachusetts Veterans Epidemiology Research and Information Center, Veterans Affairs Boston Healthcare System, Boston, MA, United States
| | - Arianna Dagliati
- Department of Electrical Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Hossein Estiri
- Department of Medicine, Massachusetts General Hospital, Boston, MA, United States
| | - Robert W Follett
- Department of Medicine, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, United States
| | | | - David A Hanauer
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, MI, United States
| | - Darren W Henderson
- Department of Biomedical Informatics, University of Kentucky, Lexington, KY, United States
| | - Yuk-Lam Ho
- Massachusetts Veterans Epidemiology Research and Information Center, Veterans Affairs Boston Healthcare System, Boston, MA, United States
| | - John H Holmes
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States.,Institute for Biomedical Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States
| | - Meghan R Hutch
- Department of Preventive Medicine, Northwestern University, Chicago, IL, United States
| | - Ramakanth Kavuluru
- Institute for Biomedical Informatics, University of Kentucky, Lexington, KY, United States
| | - Katie Kirchoff
- Medical University of South Carolina, Charleston, SC, United States
| | - Jeffrey G Klann
- Department of Medicine, Massachusetts General Hospital, Boston, MA, United States
| | - Ashok K Krishnamurthy
- Department of Computer Science, Renaissance Computing Institute, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States
| | - Trang T Le
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States
| | - Molei Liu
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA, United States
| | - Ne Hooi Will Loh
- Department of Anaesthesia, National University Health System, Singapore, Singapore
| | - Sara Lozano-Zahonero
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
| | - Yuan Luo
- Department of Preventive Medicine, Northwestern University, Chicago, IL, United States
| | - Sarah Maidlow
- Michigan Institute for Clinical & Health Research Informatics, University of Michigan, Ann Arbor, MI, United States
| | - Adeline Makoudjou
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
| | - Alberto Malovini
- Laboratory of Informatics and Systems Engineering for Clinical Research, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Italy
| | | | - Bertrand Moal
- Informatique et archivistique médicales unit, Bordeaux University Hospital, Bordeaux, France
| | - Michele Morris
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, PA, United States
| | - Danielle L Mowery
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States
| | - Shawn N Murphy
- Department of Neurology, Massachusetts General Hospital, Boston, MA, United States
| | - Antoine Neuraz
- Department of Biomedical Informatics, Hôpital Necker-Enfants Malade, Assistance Publique Hôpitaux de Paris, University of Paris, Paris, France
| | - Kee Yuan Ngiam
- Department of Biomedical Informatics, Institute for Digital Medicine, National University Health System, Singapore, Singapore
| | - Marina P Okoshi
- Internal Medicine Department, Botucatu Medical School, São Paulo State University, Botucatu, Brazil
| | - Gilbert S Omenn
- Department of Computational Medicine & Bioinformatics, Internal Medicine, Human Genetics, and Public Health, University of Michigan, Ann Arbor, MI, United States
| | - Lav P Patel
- Division of Medical Informatics, Department of Internal Medicine, University of Kansas Medical Center, Kansas City, KS, United States
| | | | - Robson A Prudente
- Internal Medicine Department, Botucatu Medical School, São Paulo State University, Botucatu, Brazil
| | | | - Fernando J Sanz Vidorreta
- Department of Medicine, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, United States
| | - Emily R Schriver
- Data Analytics Center, University of Pennsylvania Health System, Philadelphia, PA, United States
| | - Petra Schubert
- Massachusetts Veterans Epidemiology Research and Information Center, Veterans Affairs Boston Healthcare System, Boston, MA, United States
| | | | - Byorn Wl Tan
- Department of Medicine, National University Health System, Singapore, Singapore
| | - Suzana E Tanni
- Internal Medicine Department, Botucatu Medical School, São Paulo State University, Botucatu, Brazil
| | - Valentina Tibollo
- Laboratory of Informatics and Systems Engineering for Clinical Research, Istituti Clinici Scientifici Maugeri SpA SB IRCCS, Pavia, Italy
| | - Shyam Visweswaran
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, PA, United States
| | | | - Zongqi Xia
- Department of Neurology, University of Pittsburgh, Pittsburgh, PA, United States
| | - Daniela Zöller
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
| | -
- see Authors' Contributions,
| | - Isaac S Kohane
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Tianxi Cai
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Andrew M South
- Section of Nephrology, Department of Pediatrics, Brenner Children's Hospital, Wake Forest School of Medicine, Winston Salem, NC, United States
| | - Gabriel A Brat
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| |
Collapse
|
21
|
Bourgeois FT, Gutiérrez-Sacristán A, Keller MS, Liu M, Hong C, Bonzel CL, Tan ALM, Aronow BJ, Boeker M, Booth J, Cruz Rojo J, Devkota B, García Barrio N, Gehlenborg N, Geva A, Hanauer DA, Hutch MR, Issitt RW, Klann JG, Luo Y, Mandl KD, Mao C, Moal B, Moshal KL, Murphy SN, Neuraz A, Ngiam KY, Omenn GS, Patel LP, Jiménez MP, Sebire NJ, Balazote PS, Serret-Larmande A, South AM, Spiridou A, Taylor DM, Tippmann P, Visweswaran S, Weber GM, Kohane IS, Cai T, Avillach P. International Analysis of Electronic Health Records of Children and Youth Hospitalized With COVID-19 Infection in 6 Countries. JAMA Netw Open 2021; 4:e2112596. [PMID: 34115127 PMCID: PMC8196345 DOI: 10.1001/jamanetworkopen.2021.12596] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/20/2022] Open
Abstract
IMPORTANCE Additional sources of pediatric epidemiological and clinical data are needed to efficiently study COVID-19 in children and youth and inform infection prevention and clinical treatment of pediatric patients. OBJECTIVE To describe international hospitalization trends and key epidemiological and clinical features of children and youth with COVID-19. DESIGN, SETTING, AND PARTICIPANTS This retrospective cohort study included pediatric patients hospitalized between February 2 and October 10, 2020. Patient-level electronic health record (EHR) data were collected across 27 hospitals in France, Germany, Spain, Singapore, the UK, and the US. Patients younger than 21 years who tested positive for COVID-19 and were hospitalized at an institution participating in the Consortium for Clinical Characterization of COVID-19 by EHR were included in the study. MAIN OUTCOMES AND MEASURES Patient characteristics, clinical features, and medication use. RESULTS There were 347 males (52%; 95% CI, 48.5-55.3) and 324 females (48%; 95% CI, 44.4-51.3) in this study's cohort. There was a bimodal age distribution, with the greatest proportion of patients in the 0- to 2-year (199 patients [30%]) and 12- to 17-year (170 patients [25%]) age range. Trends in hospitalizations for 671 children and youth found discrete surges with variable timing across 6 countries. Data from this cohort mirrored national-level pediatric hospitalization trends for most countries with available data, with peaks in hospitalizations during the initial spring surge occurring within 23 days in the national-level and 4CE data. A total of 27 364 laboratory values for 16 laboratory tests were analyzed, with mean values indicating elevations in markers of inflammation (C-reactive protein, 83 mg/L; 95% CI, 53-112 mg/L; ferritin, 417 ng/mL; 95% CI, 228-607 ng/mL; and procalcitonin, 1.45 ng/mL; 95% CI, 0.13-2.77 ng/mL). Abnormalities in coagulation were also evident (D-dimer, 0.78 ug/mL; 95% CI, 0.35-1.21 ug/mL; and fibrinogen, 477 mg/dL; 95% CI, 385-569 mg/dL). Cardiac troponin, when checked (n = 59), was elevated (0.032 ng/mL; 95% CI, 0.000-0.080 ng/mL). Common complications included cardiac arrhythmias (15.0%; 95% CI, 8.1%-21.7%), viral pneumonia (13.3%; 95% CI, 6.5%-20.1%), and respiratory failure (10.5%; 95% CI, 5.8%-15.3%). Few children were treated with COVID-19-directed medications. CONCLUSIONS AND RELEVANCE This study of EHRs of children and youth hospitalized for COVID-19 in 6 countries demonstrated variability in hospitalization trends across countries and identified common complications and laboratory abnormalities in children and youth with COVID-19 infection. Large-scale informatics-based approaches to integrate and analyze data across health care systems complement methods of disease surveillance and advance understanding of epidemiological and clinical features associated with COVID-19 in children and youth.
Collapse
Affiliation(s)
- Florence T. Bourgeois
- Department of Pediatrics, Harvard Medical School, Boston, Massachusetts
- Computational Health Informatics Program, Boston Children’s Hospital, Boston, Massachusetts
| | | | - Mark S. Keller
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
| | - Molei Liu
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Chuan Hong
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
| | - Clara-Lea Bonzel
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
| | - Amelia L. M. Tan
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
| | - Bruce J. Aronow
- Departments of Biomedical Informatics, Pediatrics, Cincinnati Children's Hospital Medical Center, University of Cincinnati, Ohio
| | - Martin Boeker
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Germany
| | - John Booth
- Digital Research, Informatics and Virtual Environments (DRIVE), Great Ormond Street Hospital for Children, London, United Kingdom
| | - Jaime Cruz Rojo
- Department of Health Informatics, Hospital Universitario 12 de Octubre, Madrid, Spain
| | - Batsal Devkota
- Department of Biomedical Health Informatics and the Department of Pediatrics, The Children's Hospital of Philadelphia, Philadelphia, Pennsylvania
| | - Noelia García Barrio
- Department of Health Informatics, Hospital Universitario 12 de Octubre, Madrid, Spain
| | - Nils Gehlenborg
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
| | - Alon Geva
- Computational Health Informatics Program, Boston Children’s Hospital, Boston, Massachusetts
- Department of Anesthesiology, Critical Care, and Pain Medicine, Boston Children’s Hospital, Boston, Massachusetts
| | - David A. Hanauer
- Department of Learning Health Sciences, University of Michigan, Ann Arbor
| | - Meghan R. Hutch
- Department of Preventive Medicine, Northwestern University, Evanston, Illinois
| | - Richard W. Issitt
- Digital Research, Informatics and Virtual Environments (DRIVE), Great Ormond Street Hospital for Children, London, United Kingdom
| | | | - Yuan Luo
- Department of Preventive Medicine, Northwestern University, Evanston, Illinois
| | - Kenneth D. Mandl
- Computational Health Informatics Program, Boston Children’s Hospital, Boston, Massachusetts
| | - Chengsheng Mao
- Department of Preventive Medicine, Northwestern University, Evanston, Illinois
| | - Bertrand Moal
- IAM Unit, Bordeaux University Hospital, Bordeaux, France
| | - Karyn L. Moshal
- Department of Infectious Diseases, Great Ormond Street Hospital for Children, London, United Kingdom
| | - Shawn N. Murphy
- Department of Neurology, Massachusetts General Hospital, Boston, Massachusetts
| | - Antoine Neuraz
- Department of Biomedical Informatics, Hôpital Necker-Enfants Malade, Assistance Publique Hôpitaux de Paris, University of Paris, Paris, France
| | - Kee Yuan Ngiam
- Department of Biomedical informatics, WiSDM, National University Health Systems Singapore, Singapore
| | - Gilbert S Omenn
- Department of Computational Medicine & Bioinformatics, Internal Medicine, Human Genetics, & School of Public Health, University of Michigan, Ann Arbor
| | - Lav P. Patel
- Department of Internal Medicine, Division of Medical Informatics, University of Kansas Medical Center, Kansas City
| | | | - Neil J. Sebire
- Digital Research, Informatics and Virtual Environments (DRIVE), Great Ormond Street Hospital for Children, London, United Kingdom
| | | | | | - Andrew M. South
- Department of Pediatrics-Section of Nephrology, Brenner Children's Hospital, Wake Forest School of Medicine, Winston Salem, North Carolina
| | - Anastasia Spiridou
- Digital Research, Informatics and Virtual Environments (DRIVE), Great Ormond Street Hospital for Children, London, United Kingdom
| | - Deanne M. Taylor
- Department of Biomedical Health Informatics and the Department of Pediatrics, The Children's Hospital of Philadelphia, Philadelphia, Pennsylvania
- Department of Pediatrics, Perelman Medical School at the University of Pennsylvania, Philadelphia
| | - Patric Tippmann
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Germany
| | - Shyam Visweswaran
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, Pennsylvania
| | - Griffin M. Weber
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
| | - Isaac S. Kohane
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
| | - Tianxi Cai
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
| | - Paul Avillach
- Computational Health Informatics Program, Boston Children’s Hospital, Boston, Massachusetts
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
| |
Collapse
|