1
|
Eickelberg G, Sanchez-Pinto LN, Kline AS, Luo Y. Transportability of bacterial infection prediction models for critically ill patients. J Am Med Inform Assoc 2023; 31:98-108. [PMID: 37647884 PMCID: PMC10746321 DOI: 10.1093/jamia/ocad174] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2023] [Revised: 07/20/2023] [Accepted: 08/16/2023] [Indexed: 09/01/2023] Open
Abstract
OBJECTIVE Bacterial infections (BIs) are common, costly, and potentially life-threatening in critically ill patients. Patients with suspected BIs may require empiric multidrug antibiotic regimens and therefore potentially be exposed to prolonged and unnecessary antibiotics. We previously developed a BI risk model to augment practices and help shorten the duration of unnecessary antibiotics to improve patient outcomes. Here, we have performed a transportability assessment of this BI risk model in 2 tertiary intensive care unit (ICU) settings and a community ICU setting. We additionally explored how simple multisite learning techniques impacted model transportability. METHODS Patients suspected of having a community-acquired BI were identified in 3 datasets: Medical Information Mart for Intensive Care III (MIMIC), Northwestern Medicine Tertiary (NM-T) ICUs, and NM "community-based" ICUs. ICU encounters from MIMIC and NM-T datasets were split into 70/30 train and test sets. Models developed on training data were evaluated against the NM-T and MIMIC test sets, as well as NM community validation data. RESULTS During internal validations, models achieved AUROCs of 0.78 (MIMIC) and 0.81 (NM-T) and were well calibrated. In the external community ICU validation, the NM-T model had robust transportability (AUROC 0.81) while the MIMIC model transported less favorably (AUROC 0.74), likely due to case-mix differences. Multisite learning provided no significant discrimination benefit in internal validation studies but offered more stability during transport across all evaluation datasets. DISCUSSION These results suggest that our BI risk models maintain predictive utility when transported to external cohorts. CONCLUSION Our findings highlight the importance of performing external model validation on myriad clinically relevant populations prior to implementation.
Collapse
Affiliation(s)
- Garrett Eickelberg
- Department of Preventive Medicine (Health & Biomedical Informatics), Feinberg School of Medicine, Chicago, IL 60611, United States
| | - Lazaro Nelson Sanchez-Pinto
- Department of Preventive Medicine (Health & Biomedical Informatics), Feinberg School of Medicine, Chicago, IL 60611, United States
- Departments of Pediatrics (Critical Care), Chicago, IL 60611, United States
| | - Adrienne Sarah Kline
- Department of Preventive Medicine (Health & Biomedical Informatics), Feinberg School of Medicine, Chicago, IL 60611, United States
| | - Yuan Luo
- Department of Preventive Medicine (Health & Biomedical Informatics), Feinberg School of Medicine, Chicago, IL 60611, United States
| |
Collapse
|
2
|
Cousins HC, Kline AS, Wang C, Qu Y, Zengel J, Carette J, Wang M, Altman RB, Luo Y, Cong L. Integrative analysis of functional genomic screening and clinical data identifies a protective role for spironolactone in severe COVID-19. Cell Rep Methods 2023; 3:100503. [PMID: 37529368 PMCID: PMC10243122 DOI: 10.1016/j.crmeth.2023.100503] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Revised: 04/01/2023] [Accepted: 05/23/2023] [Indexed: 08/03/2023]
Abstract
We demonstrate that integrative analysis of CRISPR screening datasets enables network-based prioritization of prescription drugs modulating viral entry in severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) by developing a network-based approach called Rapid proXimity Guidance for Repurposing Investigational Drugs (RxGRID). We use our results to guide a propensity-score-matched, retrospective cohort study of 64,349 COVID-19 patients, showing that a top candidate drug, spironolactone, is associated with improved clinical prognosis, measured by intensive care unit (ICU) admission and mechanical ventilation rates. Finally, we show that spironolactone exerts a dose-dependent inhibitory effect on viral entry in human lung epithelial cells. Our RxGRID method presents a computational framework, implemented as an open-source software package, enabling genomics researchers to identify drugs likely to modulate a molecular phenotype of interest based on high-throughput screening data. Our results, derived from this method and supported by experimental and clinical analysis, add additional supporting evidence for a potential protective role of the potassium-sparing diuretic spironolactone in severe COVID-19.
Collapse
Affiliation(s)
- Henry C. Cousins
- Department of Biomedical Data Science, Stanford University School of Medicine, Stanford, CA 94305, USA
- Medical Scientist Training Program, Stanford University School of Medicine, Stanford, CA 94305, USA
| | - Adrienne Sarah Kline
- Department of Preventive Medicine, Feinberg School of Medicine, Northwestern University, Chicago, IL 60611, USA
| | - Chengkun Wang
- Department of Pathology, Stanford University School of Medicine, Stanford, CA 94305, USA
- Department of Genetics, Stanford University School of Medicine, Stanford, CA 94305, USA
| | - Yuanhao Qu
- Department of Pathology, Stanford University School of Medicine, Stanford, CA 94305, USA
- Department of Genetics, Stanford University School of Medicine, Stanford, CA 94305, USA
| | - James Zengel
- Department of Genetics, Stanford University School of Medicine, Stanford, CA 94305, USA
- Department of Microbiology and Immunology, Stanford University School of Medicine, Stanford, CA 94305, USA
| | - Jan Carette
- Department of Genetics, Stanford University School of Medicine, Stanford, CA 94305, USA
- Department of Microbiology and Immunology, Stanford University School of Medicine, Stanford, CA 94305, USA
| | - Mengdi Wang
- Department of Electronic Engineering, Princeton University, Princeton, NJ 08544, USA
| | - Russ B. Altman
- Department of Biomedical Data Science, Stanford University School of Medicine, Stanford, CA 94305, USA
- Department of Pathology, Stanford University School of Medicine, Stanford, CA 94305, USA
- Department of Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA
- Department of Bioengineering, Stanford University, Stanford, CA 94305, USA
| | - Yuan Luo
- Department of Preventive Medicine, Feinberg School of Medicine, Northwestern University, Chicago, IL 60611, USA
| | - Le Cong
- Department of Pathology, Stanford University School of Medicine, Stanford, CA 94305, USA
- Department of Genetics, Stanford University School of Medicine, Stanford, CA 94305, USA
| |
Collapse
|
3
|
Kline AS, Anderson EJ. First Report of Cowpea Aphid-Borne Mosaic Potyvirus from Cowpeas Grown Commercially in the U.S. Plant Dis 1997; 81:959. [PMID: 30866397 DOI: 10.1094/pdis.1997.81.8.959c] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Cowpea aphid-borne mosaic potyvirus (CABMV) is one of several seed-borne viruses known to limit cowpea (Vigna unguiculata (L.) Walp. subsp. unguiculata) production in Africa, Europe, and Asia, but CABMV has not been reported on commercially grown cowpeas in the United States (1). However, a sesame (Sesamum indicum L.)-infecting isolate of CABMV was recently characterized from plants growing near cowpea introduction plots in Georgia (2). In February 1997, we received samples of three seed lots of cowpea cv. Chinese Red that had been harvested in southern Texas during 1996. Approximately 28% of the plants grown from these seed lots expressed strong mosaic symptoms on primary and trifoliate leaves. Viruslike symptoms were reproduced following mechanical transmission to plants of Chinese Red cowpea, Nicotiana benthamiana, and soybean (Glycine max L.) cv. Lee. When Coronet and Pinkeye Purple Hull-BVR cowpeas were inoculated with sap extracts from symptomatic Chinese Red plants, chlorotic lesions developed on inoculated leaves, but only Coronet plants supported symptomless systemic infections. Similarly inoculated plants of Chenopodium quinoa (L.) and common bean (Phaseolus vulgaris L.) cvs. Pinto and Black Valentine developed localized chlorotic lesions. In Ouchterlony gel diffusion assays, extracts from symptomatic cowpea plants did not react with antisera to blackeye cowpea mosaic potyvirus (BlCMV), cucumber mosaic cucu-movirus (CMV), southern bean mosaic sobemovirus, cowpea mosaic comovirus, cowpea severe mosaic comovirus, or cowpea chlorotic mottle bromovirus. In the indirect enzyme-linked immunosorbent assay, sap extracts from symptomatic plants reacted with antiserum to CABMV, giving OD values at A405 of 0.10 to 0.25, and reacted weakly with antiserum to BlCMV, with OD values at A405 less than 0.035. Extracts from healthy control plants gave OD values at A405 less than 0.010. No positive reactions were obtained with antisera to bean yellow mosaic potyvirus, peanut mottle potyvirus, soybean mosaic potyvirus, or CMV. To our knowledge, this is the first report of CABMV in commercially grown cowpea from the U.S. References: (1) A. G. Gillaspie et al. Plant Dis. 79:388, 1995. (2) H. R. Pappu et al. Arch. Virol. 142:1, 1997.
Collapse
Affiliation(s)
- A S Kline
- Department of Plant Pathology, University of Arkansas, Fayetteville 72701
| | - E J Anderson
- Department of Plant Pathology, University of Arkansas, Fayetteville 72701
| |
Collapse
|
4
|
Kline AS, Anderson EJ, Smith EB. Occurrence of Cowpea Stunt Disease Causing Viruses on Wild Bean in Arkansas. Plant Dis 1997; 81:231. [PMID: 30870920 DOI: 10.1094/pdis.1997.81.2.231d] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Cucumber mosaic cucumovirus (CMV) and blackeye cowpea mosaic potyvirus (BlCMV) interact synergistically in dually infected plants to cause cowpea stunt disease (1,2). During a July 1996 survey of cowpea stunt-affected fields in the Arkansas River valley, several wild bean (Strophostyles helvola L. Elliott) plants expressing mosaic symptoms were observed and collected. Sap was extracted from symptomatic leaves and used as inoculum to conduct a host range study. Virus symptoms diagnostic for BlCMV, CMV, or cowpea stunt were observed 6 to 8 days post-inoculation on Vigna unguiculata (L.) Walp. subsp. unguiculata cv. Coronet, while chlorotic lesions and mild systemic mosaic symptoms developed on Nicotiana benthamiana. Enzyme-linked immunosorbent assays (ELISAs) conducted on extracts from symptomatic cowpea and N. benthamiana 14 days after inoculation verified the presence of CMV and BlCMV in single and mixed infections. Additional symptomatic wild bean plants were collected from the same site in October 1996. ELISAs and Ouchterlony gel diffusion assays confirmed the presence of CMV and BlCMV, as well as soybean mosaic potyvirus (SMV), cowpea chlorotic mottle bromovirus, and alfalfa mosaic virus (AlMV) in symptomatic wild bean plants. While some of the collected plants were infected with only one virus, others had combined infections of CMV and BlCMV or these two viruses with AlMV. Interestingly, AlMV isolated from wild bean caused symptoms on greenhouse-grown cowpeas that were as severe or more severe than those caused by the cowpea stunt synergy, often resulting in plant death within 8 to 10 days after inoculation. The SMV from wild bean did not induce symptoms on cowpea and was not detected in extracts from inoculated cowpea plants by Ouchterlony gel diffusion assays, but was able to systemically infect soybean (Glycine max L.) cvs. Bragg and Lee. Another virus known to infect cowpea, southern bean mosaic sobemovirus, was not detected in any of the samples tested. To our knowledge, this is the first report that wild bean can serve as an alternate host for cowpea stunt-causing viruses in single and mixed infections. In addition, these data suggest that AlMV may pose a threat to Arkansas-grown cowpeas. References: (1) E. J. Anderson et al. Ark. Farm Res. 43:14, 1994. (2) G. Pio-Ribeiro et al. Phytopathology 68:1260, 1978.
Collapse
Affiliation(s)
- A S Kline
- Department of Plant Pathology, University of Arkansas, Fayetteville 72701
| | - E J Anderson
- Department of Plant Pathology, University of Arkansas, Fayetteville 72701
| | - E B Smith
- Department of Biological Sciences, University of Arkansas, Fayetteville 72701
| |
Collapse
|