1
|
Porthiyas J, Nussey D, Beauchemin CAA, Warren DC, Quirouette C, Wilkie KP. Practical parameter identifiability and handling of censored data with Bayesian inference in mathematical tumour models. NPJ Syst Biol Appl 2024; 10:89. [PMID: 39143084 PMCID: PMC11324876 DOI: 10.1038/s41540-024-00409-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2023] [Accepted: 07/21/2024] [Indexed: 08/16/2024] Open
Abstract
Mechanistic mathematical models (MMs) are a powerful tool to help us understand and predict the dynamics of tumour growth under various conditions. In this work, we use 5 MMs with an increasing number of parameters to explore how certain (often overlooked) decisions in estimating parameters from data of experimental tumour growth affect the outcome of the analysis. In particular, we propose a framework for including tumour volume measurements that fall outside the upper and lower limits of detection, which are normally discarded. We demonstrate how excluding censored data results in an overestimation of the initial tumour volume and the MM-predicted tumour volumes prior to the first measurements, and an underestimation of the carrying capacity and the MM-predicted tumour volumes beyond the latest measurable time points. We show in which way the choice of prior for the MM parameters can impact the posterior distributions, and illustrate that reporting the most likely parameters and their 95% credible interval can lead to confusing or misleading interpretations. We hope this work will encourage others to carefully consider choices made in parameter estimation and to adopt the approaches we put forward herein.
Collapse
Affiliation(s)
- Jamie Porthiyas
- Department of Mathematics, Toronto Metropolitan University, Toronto, ON, M5B 2K3, Canada
| | - Daniel Nussey
- Department of Mathematics, Toronto Metropolitan University, Toronto, ON, M5B 2K3, Canada
| | - Catherine A A Beauchemin
- Department of Physics, Toronto Metropolitan University, Toronto, ON, M5B 2K3, Canada
- Interdisciplinary Theoretical and Mathematical Sciences (iTHEMS) Program, RIKEN, Wako-shi, Saitama, 351-0198, Japan
| | - Donald C Warren
- Interdisciplinary Theoretical and Mathematical Sciences (iTHEMS) Program, RIKEN, Wako-shi, Saitama, 351-0198, Japan
- Florida Institute of Technology, Melbourne, FL, 32901, USA
| | - Christian Quirouette
- Department of Physics, Toronto Metropolitan University, Toronto, ON, M5B 2K3, Canada
| | - Kathleen P Wilkie
- Department of Mathematics, Toronto Metropolitan University, Toronto, ON, M5B 2K3, Canada.
| |
Collapse
|
2
|
Kieran TJ, Maines TR, Belser JA. Data alchemy, from lab to insight: Transforming in vivo experiments into data science gold. PLoS Pathog 2024; 20:e1012460. [PMID: 39208339 PMCID: PMC11361667 DOI: 10.1371/journal.ppat.1012460] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/04/2024] Open
Affiliation(s)
- Troy J. Kieran
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America
| | - Taronna R. Maines
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America
| | - Jessica A. Belser
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America
| |
Collapse
|
3
|
Kieran TJ, Sun X, Maines TR, Belser JA. Machine learning approaches for influenza A virus risk assessment identifies predictive correlates using ferret model in vivo data. Commun Biol 2024; 7:927. [PMID: 39090358 PMCID: PMC11294530 DOI: 10.1038/s42003-024-06629-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2024] [Accepted: 07/24/2024] [Indexed: 08/04/2024] Open
Abstract
In vivo assessments of influenza A virus (IAV) pathogenicity and transmissibility in ferrets represent a crucial component of many pandemic risk assessment rubrics, but few systematic efforts to identify which data from in vivo experimentation are most useful for predicting pathogenesis and transmission outcomes have been conducted. To this aim, we aggregated viral and molecular data from 125 contemporary IAV (H1, H2, H3, H5, H7, and H9 subtypes) evaluated in ferrets under a consistent protocol. Three overarching predictive classification outcomes (lethality, morbidity, transmissibility) were constructed using machine learning (ML) techniques, employing datasets emphasizing virological and clinical parameters from inoculated ferrets, limited to viral sequence-based information, or combining both data types. Among 11 different ML algorithms tested and assessed, gradient boosting machines and random forest algorithms yielded the highest performance, with models for lethality and transmission consistently better performing than models predicting morbidity. Comparisons of feature selection among models was performed, and highest performing models were validated with results from external risk assessment studies. Our findings show that ML algorithms can be used to summarize complex in vivo experimental work into succinct summaries that inform and enhance risk assessment criteria for pandemic preparedness that take in vivo data into account.
Collapse
Affiliation(s)
- Troy J Kieran
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, GA, USA.
| | - Xiangjie Sun
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, GA, USA
| | - Taronna R Maines
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, GA, USA
| | - Jessica A Belser
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, GA, USA.
| |
Collapse
|
4
|
Kieran TJ, Sun X, Creager HM, Tumpey TM, Maines TR, Belser JA. An aggregated dataset of serial morbidity and titer measurements from influenza A virus-infected ferrets. Sci Data 2024; 11:510. [PMID: 38760422 PMCID: PMC11101425 DOI: 10.1038/s41597-024-03256-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2024] [Accepted: 04/11/2024] [Indexed: 05/19/2024] Open
Abstract
Data from influenza A virus (IAV) infected ferrets provides invaluable information towards the study of novel and emerging viruses that pose a threat to human health. This gold standard model can recapitulate many clinical signs of infection present in IAV-infected humans, support virus replication of human, avian, swine, and other zoonotic strains without prior adaptation, and permit evaluation of virus transmissibility by multiple modes. While ferrets have been employed in risk assessment settings for >20 years, results from this work are typically reported in discrete stand-alone publications, making aggregation of raw data from this work over time nearly impossible. Here, we describe a dataset of 728 ferrets inoculated with 126 unique IAV, conducted by a single research group under a uniform experimental protocol. This collection of morbidity, mortality, and viral titer data represents the largest publicly available dataset to date of in vivo-generated IAV infection outcomes on a per-ferret level.
Collapse
Affiliation(s)
- Troy J Kieran
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, GA, USA
| | - Xiangjie Sun
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, GA, USA
| | - Hannah M Creager
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, GA, USA
- University of Pittsburgh, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania, USA
| | - Terrence M Tumpey
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, GA, USA
| | - Taronna R Maines
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, GA, USA.
| | - Jessica A Belser
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, GA, USA.
| |
Collapse
|
5
|
Belser JA, Kieran TJ, Mitchell ZA, Sun X, Mayfield K, Tumpey TM, Spengler JR, Maines TR. Key considerations to improve the normalization, interpretation and reproducibility of morbidity data in mammalian models of viral disease. Dis Model Mech 2024; 17:dmm050511. [PMID: 38440823 PMCID: PMC10941659 DOI: 10.1242/dmm.050511] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Accepted: 02/05/2024] [Indexed: 03/06/2024] Open
Abstract
Viral pathogenesis and therapeutic screening studies that utilize small mammalian models rely on the accurate quantification and interpretation of morbidity measurements, such as weight and body temperature, which can vary depending on the model, agent and/or experimental design used. As a result, morbidity-related data are frequently normalized within and across screening studies to aid with their interpretation. However, such data normalization can be performed in a variety of ways, leading to differences in conclusions drawn and making comparisons between studies challenging. Here, we discuss variability in the normalization, interpretation, and presentation of morbidity measurements for four model species frequently used to study a diverse range of human viral pathogens - mice, hamsters, guinea pigs and ferrets. We also analyze findings aggregated from influenza A virus-infected ferrets to contextualize this discussion. We focus on serially collected weight and temperature data to illustrate how the conclusions drawn from this information can vary depending on how raw data are collected, normalized and measured. Taken together, this work supports continued efforts in understanding how normalization affects the interpretation of morbidity data and highlights best practices to improve the interpretation and utility of these findings for extrapolation to public health contexts.
Collapse
Affiliation(s)
- Jessica A. Belser
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, GA 30329, USA
| | - Troy J. Kieran
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, GA 30329, USA
| | - Zoë A. Mitchell
- Franklin College of Arts and Sciences, University of Georgia, Athens, GA 30602, USA
- Division of Scientific Resources, Centers for Disease Control and Prevention, Atlanta, GA 30329, USA
| | - Xiangjie Sun
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, GA 30329, USA
| | - Kristin Mayfield
- Division of Scientific Resources, Centers for Disease Control and Prevention, Atlanta, GA 30329, USA
| | - Terrence M. Tumpey
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, GA 30329, USA
| | - Jessica R. Spengler
- Division of High-Consequence Pathogens and Pathology, Centers for Disease Control and Prevention, Atlanta, GA 30329, USA
| | - Taronna R. Maines
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, GA 30329, USA
| |
Collapse
|
6
|
Kieran TJ, Sun X, Maines TR, Beauchemin CAA, Belser JA. Exploring associations between viral titer measurements and disease outcomes in ferrets inoculated with 125 contemporary influenza A viruses. J Virol 2024; 98:e0166123. [PMID: 38240592 PMCID: PMC10878272 DOI: 10.1128/jvi.01661-23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Accepted: 12/16/2023] [Indexed: 02/21/2024] Open
Abstract
As use of the ferret model to study influenza A virus (IAV) pathogenicity increases, periodic assessment of data generated in this model is warranted, to identify features associated with virus replication throughout the respiratory tract and to refine future analyses. However, protocol-specific differences present between independent laboratories limit easy aggregation of virological data. We compiled viral titer and clinical data from >1,000 ferrets inoculated with 125 contemporary IAV under a consistent experimental protocol (including high- and low-pathogenicity avian, swine-origin, and human viruses, spanning H1, H2, H3, H5, H7, and H9 subtypes) and examined which meaningful and statistically supported associations were present among numerous quantitative measurements. Viral titers correlated positively between ferret nasal turbinate tissue, lung tissue, and nasal wash specimens, though the strength of the associations varied, notably regarding the particular nasal wash summary measure employed and properties of the virus itself. Use of correlation coefficients and mediation analyses further supported the interconnectedness of viral titer measurements taken at different sites throughout the respiratory tract. IAV possessing mammalian host adaptation markers in the HA and PB2 exhibited more rapid growth in the ferret upper respiratory tract early after infection, supported by quantities derived from infectious titer data to capture infection progression, compared with viruses bearing hallmarks of avian IAV. Collectively, this work identifies summary metrics most closely linked with virological and phenotypic outcomes in ferrets, supporting continued refinement of data analyzed from in vivo experimentation, notably from studies conducted to evaluate the public health risk posed by novel and emerging IAV.IMPORTANCEFerrets are frequently employed to study the pandemic potential of novel and emerging influenza A viruses. However, systematic retrospective analyses of data generated from these experiments are rarely performed, limiting our ability to identify trends in this data and explore how analyses can be refined. Using logarithmic viral titer and clinical data aggregated from one research group over 20 years, we assessed which meaningful and statistically supported associations were present among numerous quantitative measurements obtained from influenza A virus (IAV)-infected ferrets, including those capturing viral titers, infection progression, and disease severity. We identified numerous linear correlations between parameters assessing virus replication at discrete sites in vivo, including parameters capturing infection progression not frequently employed in the field, and sought to investigate the interconnected nature of these associations. This work supports continued refinement of data analyzed from in vivo experimentation, notably from studies which evaluate the public health risk posed by IAV.
Collapse
Affiliation(s)
- Troy J. Kieran
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, Georgia, USA
| | - Xiangjie Sun
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, Georgia, USA
| | - Taronna R. Maines
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, Georgia, USA
| | - Catherine A. A. Beauchemin
- Department of Physics, Toronto Metropolitan University, Toronto, Canada
- Interdisciplinary Theoretical and Mathematical Sciences (iTHEMS) at RIKEN, Wako, Japan
| | - Jessica A. Belser
- Influenza Division, Centers for Disease Control and Prevention, Atlanta, Georgia, USA
| |
Collapse
|