1
|
Wang S, Al-Radhawi MA, Lauffenburger DA, Sontag ED. Recovering biomolecular network dynamics from single-cell omics data requires three time points. NPJ Syst Biol Appl 2024; 10:97. [PMID: 39191787 DOI: 10.1038/s41540-024-00424-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2024] [Accepted: 08/10/2024] [Indexed: 08/29/2024] Open
Abstract
Single-cell omics technologies can measure millions of cells for up to thousands of biomolecular features, enabling data-driven studies of complex biological networks. However, these high-throughput experimental techniques often cannot track individual cells over time, thus complicating the understanding of dynamics such as time trajectories of cell states. These "dynamical phenotypes" are key to understanding biological phenomena such as differentiation fates. We show by mathematical analysis that, in spite of high dimensionality and lack of individual cell traces, three time-points of single-cell omics data are theoretically necessary and sufficient to uniquely determine the network interaction matrix and associated dynamics. Moreover, we show through numerical simulations that an interaction matrix can be accurately determined with three or more time-points even in the presence of sampling and measurement noise typical of single-cell omics. Our results can guide the design of single-cell omics time-course experiments, and provide a tool for data-driven phase-space analysis.
Collapse
Affiliation(s)
- Shu Wang
- Donnelly Centre, University of Toronto, Toronto, ON, Canada
- Molecular Genetics, University of Toronto, Toronto, ON, Canada
- Department of Biological Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Muhammad Ali Al-Radhawi
- Departments of Bioengineering and Electrical & Computer Engineering, Northeastern University, Boston, MA, USA
| | - Douglas A Lauffenburger
- Department of Biological Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA.
| | - Eduardo D Sontag
- Departments of Bioengineering and Electrical & Computer Engineering, Northeastern University, Boston, MA, USA.
| |
Collapse
|
2
|
Go N, Arsène S, Faddeenkov I, Galland T, Martis B S, Lefaudeux D, Wang Y, Etheve L, Jacob E, Monteiro C, Bosley J, Sansone C, Pasquali C, Lehr L, Kulesza A. A quantitative systems pharmacology workflow toward optimal design and biomarker stratification of atopic dermatitis clinical trials. J Allergy Clin Immunol 2024; 153:1330-1343. [PMID: 38369029 DOI: 10.1016/j.jaci.2023.12.031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Revised: 11/03/2023] [Accepted: 12/22/2023] [Indexed: 02/20/2024]
Abstract
BACKGROUND The development of atopic dermatitis (AD) drugs is challenged by many disease phenotypes and trial design options, which are hard to explore experimentally. OBJECTIVE We aimed to optimize AD trial design using simulations. METHODS We constructed a quantitative systems pharmacology model of AD and standard of care (SoC) treatments and generated a phenotypically diverse virtual population whose parameter distribution was derived from known relationships between AD biomarkers and disease severity and calibrated using disease severity evolution under SoC regimens. RESULTS We applied this workflow to the immunomodulator OM-85, currently being investigated for its potential use in AD, and calibrated the investigational treatment model with the efficacy profile of an existing trial (thereby enriching it with plausible marker levels and dynamics). We assessed the sensitivity of trial outcomes to trial protocol and found that for this particular example the choice of end point is more important than the choice of dosing regimen and patient selection by model-based responder enrichment could increase the expected effect size. A global sensitivity analysis revealed that only a limited subset of baseline biomarkers is needed to predict the drug response of the full virtual population. CONCLUSIONS This AD quantitative systems pharmacology workflow built around knowledge of marker-severity relationships as well as SoC efficacy can be tailored to specific development cases to optimize several trial protocol parameters and biomarker stratification and therefore has promise to become a powerful model-informed AD drug development and personalized medicine tool.
Collapse
|
3
|
Stapor P, Schmiester L, Wierling C, Merkt S, Pathirana D, Lange BMH, Weindl D, Hasenauer J. Mini-batch optimization enables training of ODE models on large-scale datasets. Nat Commun 2022; 13:34. [PMID: 35013141 PMCID: PMC8748893 DOI: 10.1038/s41467-021-27374-6] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2019] [Accepted: 11/11/2021] [Indexed: 11/09/2022] Open
Abstract
Quantitative dynamic models are widely used to study cellular signal processing. A critical step in modelling is the estimation of unknown model parameters from experimental data. As model sizes and datasets are steadily growing, established parameter optimization approaches for mechanistic models become computationally extremely challenging. Mini-batch optimization methods, as employed in deep learning, have better scaling properties. In this work, we adapt, apply, and benchmark mini-batch optimization for ordinary differential equation (ODE) models, thereby establishing a direct link between dynamic modelling and machine learning. On our main application example, a large-scale model of cancer signaling, we benchmark mini-batch optimization against established methods, achieving better optimization results and reducing computation by more than an order of magnitude. We expect that our work will serve as a first step towards mini-batch optimization tailored to ODE models and enable modelling of even larger and more complex systems than what is currently possible.
Collapse
Affiliation(s)
- Paul Stapor
- Helmholtz Zentrum München - German Research Center for Environmental Health, Institute of Computational Biology, 85764, Neuherberg, Germany
- Technische Universität München, Center for Mathematics, Chair of Mathematical Modeling of Biological Systems, 85748, Garching, Germany
| | - Leonard Schmiester
- Helmholtz Zentrum München - German Research Center for Environmental Health, Institute of Computational Biology, 85764, Neuherberg, Germany
- Technische Universität München, Center for Mathematics, Chair of Mathematical Modeling of Biological Systems, 85748, Garching, Germany
| | | | - Simon Merkt
- Universität Bonn, Faculty of Mathematics and Natural Sciences, 53115, Bonn, Germany
| | - Dilan Pathirana
- Universität Bonn, Faculty of Mathematics and Natural Sciences, 53115, Bonn, Germany
| | | | - Daniel Weindl
- Helmholtz Zentrum München - German Research Center for Environmental Health, Institute of Computational Biology, 85764, Neuherberg, Germany
| | - Jan Hasenauer
- Helmholtz Zentrum München - German Research Center for Environmental Health, Institute of Computational Biology, 85764, Neuherberg, Germany.
- Technische Universität München, Center for Mathematics, Chair of Mathematical Modeling of Biological Systems, 85748, Garching, Germany.
- Universität Bonn, Faculty of Mathematics and Natural Sciences, 53115, Bonn, Germany.
| |
Collapse
|
4
|
Stability Analysis and Optimization of Semi-Explicit Predictor–Corrector Methods. MATHEMATICS 2021. [DOI: 10.3390/math9192463] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The increasing complexity of advanced devices and systems increases the scale of mathematical models used in computer simulations. Multiparametric analysis and study on long-term time intervals of large-scale systems are computationally expensive. Therefore, efficient numerical methods are required to reduce time costs. Recently, semi-explicit and semi-implicit Adams–Bashforth–Moulton methods have been proposed, showing great computational efficiency in low-dimensional systems simulation. In this study, we examine the numerical stability of these methods by plotting stability regions. We explicitly show that semi-explicit methods possess higher numerical stability than the conventional predictor–corrector algorithms. The second contribution of the reported research is a novel algorithm to generate an optimized finite-difference scheme of semi-explicit and semi-implicit Adams–Bashforth–Moulton methods without redundant computation of predicted values that are not used for correction. The experimental part of the study includes the numerical simulation of the three-body problem and a network of coupled oscillators with a fixed and variable integration step and finely confirms the theoretical findings.
Collapse
|
5
|
Städter P, Schälte Y, Schmiester L, Hasenauer J, Stapor PL. Benchmarking of numerical integration methods for ODE models of biological systems. Sci Rep 2021; 11:2696. [PMID: 33514831 PMCID: PMC7846608 DOI: 10.1038/s41598-021-82196-2] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2020] [Accepted: 01/08/2021] [Indexed: 11/09/2022] Open
Abstract
Ordinary differential equation (ODE) models are a key tool to understand complex mechanisms in systems biology. These models are studied using various approaches, including stability and bifurcation analysis, but most frequently by numerical simulations. The number of required simulations is often large, e.g., when unknown parameters need to be inferred. This renders efficient and reliable numerical integration methods essential. However, these methods depend on various hyperparameters, which strongly impact the ODE solution. Despite this, and although hundreds of published ODE models are freely available in public databases, a thorough study that quantifies the impact of hyperparameters on the ODE solver in terms of accuracy and computation time is still missing. In this manuscript, we investigate which choices of algorithms and hyperparameters are generally favorable when dealing with ODE models arising from biological processes. To ensure a representative evaluation, we considered 142 published models. Our study provides evidence that most ODEs in computational biology are stiff, and we give guidelines for the choice of algorithms and hyperparameters. We anticipate that our results will help researchers in systems biology to choose appropriate numerical methods when dealing with ODE models.
Collapse
Affiliation(s)
- Philipp Städter
- Institute of Computational Biology, Helmholtz Zentrum München - German Research Center for Environmental Health, 85764, Neuherberg, Germany
- Center for Mathematics, Technische Universität München, 85748, Garching, Germany
| | - Yannik Schälte
- Institute of Computational Biology, Helmholtz Zentrum München - German Research Center for Environmental Health, 85764, Neuherberg, Germany
- Center for Mathematics, Technische Universität München, 85748, Garching, Germany
| | - Leonard Schmiester
- Institute of Computational Biology, Helmholtz Zentrum München - German Research Center for Environmental Health, 85764, Neuherberg, Germany
- Center for Mathematics, Technische Universität München, 85748, Garching, Germany
| | - Jan Hasenauer
- Institute of Computational Biology, Helmholtz Zentrum München - German Research Center for Environmental Health, 85764, Neuherberg, Germany.
- Center for Mathematics, Technische Universität München, 85748, Garching, Germany.
- Faculty of Mathematics and Natural Sciences, University of Bonn, 53113, Bonn, Germany.
| | - Paul L Stapor
- Institute of Computational Biology, Helmholtz Zentrum München - German Research Center for Environmental Health, 85764, Neuherberg, Germany
- Center for Mathematics, Technische Universität München, 85748, Garching, Germany
| |
Collapse
|
6
|
van Rosmalen RP, Smith RW, Martins Dos Santos VAP, Fleck C, Suarez-Diez M. Model reduction of genome-scale metabolic models as a basis for targeted kinetic models. Metab Eng 2021; 64:74-84. [PMID: 33486094 DOI: 10.1016/j.ymben.2021.01.008] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2020] [Revised: 01/05/2021] [Accepted: 01/15/2021] [Indexed: 11/26/2022]
Abstract
Constraint-based, genome-scale metabolic models are an essential tool to guide metabolic engineering. However, they lack the detail and time dimension that kinetic models with enzyme dynamics offer. Model reduction can be used to bridge the gap between the two methods and allow for the integration of kinetic models into the Design-Built-Test-Learn cycle. Here we show that these reduced size models can be representative of the dynamics of the original model and demonstrate the automated generation and parameterisation of such models. Using these minimal models of metabolism could allow for further exploration of dynamic responses in metabolic networks.
Collapse
Affiliation(s)
- R P van Rosmalen
- Laboratory of Systems and Synthetic Biology, Department of Agrotechnology and Food Sciences, Wageningen University & Research, Wageningen, the Netherlands
| | - R W Smith
- Laboratory of Systems and Synthetic Biology, Department of Agrotechnology and Food Sciences, Wageningen University & Research, Wageningen, the Netherlands
| | - V A P Martins Dos Santos
- Laboratory of Systems and Synthetic Biology, Department of Agrotechnology and Food Sciences, Wageningen University & Research, Wageningen, the Netherlands; Lifeglimmer GmbH, Berlin, Germany
| | - C Fleck
- Freiburg Center for Data Analysis and Modelling University of Freiburg Freiburg Germany; Control Theory and Systems Biology Laboratory, Department of Biosystems Science and En- gineering, ETH Zürich, Basel, Switzerland
| | - M Suarez-Diez
- Laboratory of Systems and Synthetic Biology, Department of Agrotechnology and Food Sciences, Wageningen University & Research, Wageningen, the Netherlands.
| |
Collapse
|