1
|
Porthiyas J, Nussey D, Beauchemin CAA, Warren DC, Quirouette C, Wilkie KP. Practical parameter identifiability and handling of censored data with Bayesian inference in mathematical tumour models. NPJ Syst Biol Appl 2024; 10:89. [PMID: 39143084 PMCID: PMC11324876 DOI: 10.1038/s41540-024-00409-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2023] [Accepted: 07/21/2024] [Indexed: 08/16/2024] Open
Abstract
Mechanistic mathematical models (MMs) are a powerful tool to help us understand and predict the dynamics of tumour growth under various conditions. In this work, we use 5 MMs with an increasing number of parameters to explore how certain (often overlooked) decisions in estimating parameters from data of experimental tumour growth affect the outcome of the analysis. In particular, we propose a framework for including tumour volume measurements that fall outside the upper and lower limits of detection, which are normally discarded. We demonstrate how excluding censored data results in an overestimation of the initial tumour volume and the MM-predicted tumour volumes prior to the first measurements, and an underestimation of the carrying capacity and the MM-predicted tumour volumes beyond the latest measurable time points. We show in which way the choice of prior for the MM parameters can impact the posterior distributions, and illustrate that reporting the most likely parameters and their 95% credible interval can lead to confusing or misleading interpretations. We hope this work will encourage others to carefully consider choices made in parameter estimation and to adopt the approaches we put forward herein.
Collapse
Affiliation(s)
- Jamie Porthiyas
- Department of Mathematics, Toronto Metropolitan University, Toronto, ON, M5B 2K3, Canada
| | - Daniel Nussey
- Department of Mathematics, Toronto Metropolitan University, Toronto, ON, M5B 2K3, Canada
| | - Catherine A A Beauchemin
- Department of Physics, Toronto Metropolitan University, Toronto, ON, M5B 2K3, Canada
- Interdisciplinary Theoretical and Mathematical Sciences (iTHEMS) Program, RIKEN, Wako-shi, Saitama, 351-0198, Japan
| | - Donald C Warren
- Interdisciplinary Theoretical and Mathematical Sciences (iTHEMS) Program, RIKEN, Wako-shi, Saitama, 351-0198, Japan
- Florida Institute of Technology, Melbourne, FL, 32901, USA
| | - Christian Quirouette
- Department of Physics, Toronto Metropolitan University, Toronto, ON, M5B 2K3, Canada
| | - Kathleen P Wilkie
- Department of Mathematics, Toronto Metropolitan University, Toronto, ON, M5B 2K3, Canada.
| |
Collapse
|
2
|
Saxton H, Xu X, Schenkel T, Clayton RH, Halliday I. Convergence, sampling and total order estimator effects on parameter orthogonality in global sensitivity analysis. PLoS Comput Biol 2024; 20:e1011946. [PMID: 39018334 DOI: 10.1371/journal.pcbi.1011946] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2024] [Revised: 07/29/2024] [Accepted: 06/13/2024] [Indexed: 07/19/2024] Open
Abstract
Dynamical system models typically involve numerous input parameters whose "effects" and orthogonality need to be quantified through sensitivity analysis, to identify inputs contributing the greatest uncertainty. Whilst prior art has compared total-order estimators' role in recovering "true" effects, assessing their ability to recover robust parameter orthogonality for use in identifiability metrics has not been investigated. In this paper, we perform: (i) an assessment using a different class of numerical models representing the cardiovascular system, (ii) a wider evaluation of sampling methodologies and their interactions with estimators, (iii) an investigation of the consequences of permuting estimators and sampling methodologies on input parameter orthogonality, (iv) a study of sample convergence through resampling, and (v) an assessment of whether positive outcomes are sustained when model input dimensionality increases. Our results indicate that Jansen or Janon estimators display efficient convergence with minimum uncertainty when coupled with Sobol and the lattice rule sampling methods, making them prime choices for calculating parameter orthogonality and influence. This study reveals that global sensitivity analysis is convergence driven. Unconverged indices are subject to error and therefore the true influence or orthogonality of the input parameters are not recovered. This investigation importantly clarifies the interactions of the estimator and the sampling methodology by reducing the associated ambiguities, defining novel practices for modelling in the life sciences.
Collapse
Affiliation(s)
- Harry Saxton
- Materials & Engineering Research Institute, Sheffield Hallam University, Sheffield, United Kingdom
| | - Xu Xu
- Department of Computer Science, Faculty of Engineering, University of Sheffield, Sheffield, United Kingdom
- Insigneo Institute for in silico Medicine, University of Sheffield, Sheffield, United Kingdom
| | - Torsten Schenkel
- Department of Engineering and Mathematics, Sheffield Hallam University, Sheffield, United Kingdom
| | - Richard H Clayton
- Department of Computer Science, Faculty of Engineering, University of Sheffield, Sheffield, United Kingdom
- Insigneo Institute for in silico Medicine, University of Sheffield, Sheffield, United Kingdom
| | - Ian Halliday
- Insigneo Institute for in silico Medicine, University of Sheffield, Sheffield, United Kingdom
- Clinical Medicine, School of Medicine and Population Health, University of Sheffield, Sheffield, United Kingdom
| |
Collapse
|
3
|
Conte M, Woodall RT, Gutova M, Chen BT, Shiroishi MS, Brown CE, Munson JM, Rockne RC. Structural and practical identifiability of contrast transport models for DCE-MRI. PLoS Comput Biol 2024; 20:e1012106. [PMID: 38748755 PMCID: PMC11132485 DOI: 10.1371/journal.pcbi.1012106] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2023] [Revised: 05/28/2024] [Accepted: 04/24/2024] [Indexed: 05/28/2024] Open
Abstract
Contrast transport models are widely used to quantify blood flow and transport in dynamic contrast-enhanced magnetic resonance imaging. These models analyze the time course of the contrast agent concentration, providing diagnostic and prognostic value for many biological systems. Thus, ensuring accuracy and repeatability of the model parameter estimation is a fundamental concern. In this work, we analyze the structural and practical identifiability of a class of nested compartment models pervasively used in analysis of MRI data. We combine artificial and real data to study the role of noise in model parameter estimation. We observe that although all the models are structurally identifiable, practical identifiability strongly depends on the data characteristics. We analyze the impact of increasing data noise on parameter identifiability and show how the latter can be recovered with increased data quality. To complete the analysis, we show that the results do not depend on specific tissue characteristics or the type of enhancement patterns of contrast agent signal.
Collapse
Affiliation(s)
- Martina Conte
- Department of Mathematical Sciences “G. L. Lagrange”, Politecnico di Torino, Torino, Italy
- Division of Mathematical Oncology and Computational Systems Biology, Department of Computational and Quantitative Medicine, Beckman Research Institute, City of Hope National Medical Center, Duarte, California, United States of America
| | - Ryan T. Woodall
- Division of Mathematical Oncology and Computational Systems Biology, Department of Computational and Quantitative Medicine, Beckman Research Institute, City of Hope National Medical Center, Duarte, California, United States of America
| | - Margarita Gutova
- Department of Stem Cell Biology and Regenerative Medicine, Beckman Research Institute, City of Hope National Medical Center, Duarte, California, United States of America
| | - Bihong T. Chen
- Department of Diagnostic Radiology, City of Hope National Medical Center, Duarte, California, United States of America
| | - Mark S. Shiroishi
- Department of Radiology, Keck School of Medicine of the University of Southern California, Los Angeles, California, United States of America
| | - Christine E. Brown
- Departments of Hematology & Hematopoietic Cell Transplantation and Immuno-Oncology, Beckman Research Institute, City of Hope National Medical Center Duarte, California, United States of America
| | - Jennifer M. Munson
- Fralin Biomedical Research Institute, Virginia Tech, Roanoke, Virginia, United States of America
| | - Russell C. Rockne
- Division of Mathematical Oncology and Computational Systems Biology, Department of Computational and Quantitative Medicine, Beckman Research Institute, City of Hope National Medical Center, Duarte, California, United States of America
| |
Collapse
|
4
|
Conte M, Woodall RT, Gutova M, Chen BT, Shiroishi MS, Brown CE, Munson JM, Rockne RC. Structural and practical identifiability of contrast transport models for DCE-MRI. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.12.19.572294. [PMID: 38187554 PMCID: PMC10769233 DOI: 10.1101/2023.12.19.572294] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/09/2024]
Abstract
Compartment models are widely used to quantify blood flow and transport in dynamic contrast-enhanced magnetic resonance imaging. These models analyze the time course of the contrast agent concentration, providing diagnostic and prognostic value for many biological systems. Thus, ensuring accuracy and repeatability of the model parameter estimation is a fundamental concern. In this work, we analyze the structural and practical identifiability of a class of nested compartment models pervasively used in analysis of MRI data. We combine artificial and real data to study the role of noise in model parameter estimation. We observe that although all the models are structurally identifiable, practical identifiability strongly depends on the data characteristics. We analyze the impact of increasing data noise on parameter identifiability and show how the latter can be recovered with increased data quality. To complete the analysis, we show that the results do not depend on specific tissue characteristics or the type of enhancement patterns of contrast agent signal.
Collapse
|
5
|
Cortesi M, Liu D, Yee C, Marsh DJ, Ford CE. A comparative analysis of 2D and 3D experimental data for the identification of the parameters of computational models. Sci Rep 2023; 13:15769. [PMID: 37737283 PMCID: PMC10517149 DOI: 10.1038/s41598-023-42486-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Accepted: 09/11/2023] [Indexed: 09/23/2023] Open
Abstract
Computational models are becoming an increasingly valuable tool in biomedical research. Their accuracy and effectiveness, however, rely on the identification of suitable parameters and on appropriate validation of the in-silico framework. Both these steps are highly dependent on the experimental model used as a reference to acquire the data. Selecting the most appropriate experimental framework thus becomes key, together with the analysis of the effect of combining results from different experimental models, a common practice often necessary due to limited data availability. In this work, the same in-silico model of ovarian cancer cell growth and metastasis, was calibrated with datasets acquired from traditional 2D monolayers, 3D cell culture models or a combination of the two. The comparison between the parameters sets obtained in the different conditions, together with the corresponding simulated behaviours, is presented. It provides a framework for the study of the effect of the different experimental models on the development of computational systems. This work also provides a set of general guidelines for the comparative testing and selection of experimental models and protocols to be used for parameter optimization in computational models.
Collapse
Affiliation(s)
- Marilisa Cortesi
- Gynaecological Cancer Research Group, School of Clinical Medicine, Faculty of Medicine and Health, University of New South Wales, Kensington, NSW, Australia.
- Laboratory of Cellular and Molecular Engineering, Department of Electrical Electronic and Information Engineering "G. Marconi", Alma Mater Studiorum-University of Bologna, Cesena, Italy.
| | - Dongli Liu
- Gynaecological Cancer Research Group, School of Clinical Medicine, Faculty of Medicine and Health, University of New South Wales, Kensington, NSW, Australia
| | - Christine Yee
- Translational Oncology Group, School of Life Sciences, Faculty of Science, University of Technology Sydney, Ultimo, NSW, Australia
| | - Deborah J Marsh
- Translational Oncology Group, School of Life Sciences, Faculty of Science, University of Technology Sydney, Ultimo, NSW, Australia
| | - Caroline E Ford
- Gynaecological Cancer Research Group, School of Clinical Medicine, Faculty of Medicine and Health, University of New South Wales, Kensington, NSW, Australia.
| |
Collapse
|