1
|
Toni T, Dua P, van der Graaf PH. Systems Pharmacology of the NGF Signaling Through p75 and TrkA Receptors. CPT Pharmacometrics Syst Pharmacol 2014; 3:e150. [PMID: 25470184 PMCID: PMC4288001 DOI: 10.1038/psp.2014.48] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/02/2014] [Accepted: 09/12/2014] [Indexed: 02/07/2023]
Abstract
The nerve growth factor (NGF) pathway has been shown to play a key role in pain treatment. Recently, a systems pharmacology model has been proposed that can aid in the identification and validation of drug targets in the NGF pathway. However, this model did not include the role of the p75 receptor, which modulates the signaling of NGF through the tropomyosin receptor kinase A (TrkA). The precise mechanism of the interaction between these two receptors has not been completely elucidated, and we therefore adopted a systems pharmacology modeling approach to gain understanding of the effect of p75 on the dynamics of NGF signal transduction. Specifically, models were developed for the so-called heterodimer and for the ligand-passing hypotheses. We used the model to compare the effect of inhibition of NGF and TrkA and its implication for drug discovery and development for pain treatment.
Collapse
Affiliation(s)
- T Toni
- Department of Life Sciences, Imperial College London, London, UK
| | - P Dua
- Pharmatherapeutics Research Clinical Pharmacology, Pfizer Neusentis, Cambridge, UK
| | - P H van der Graaf
- Leiden Academic Centre for Drug Research (LACDR), Systems Pharmacology Cluster, Leiden, The Netherlands
| |
Collapse
|
2
|
Silk D, Kirk PDW, Barnes CP, Toni T, Stumpf MPH. Model selection in systems biology depends on experimental design. PLoS Comput Biol 2014; 10:e1003650. [PMID: 24922483 PMCID: PMC4055659 DOI: 10.1371/journal.pcbi.1003650] [Citation(s) in RCA: 44] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2013] [Accepted: 04/10/2014] [Indexed: 12/01/2022] Open
Abstract
Experimental design attempts to maximise the information available for modelling tasks. An optimal experiment allows the inferred models or parameters to be chosen with the highest expected degree of confidence. If the true system is faithfully reproduced by one of the models, the merit of this approach is clear - we simply wish to identify it and the true parameters with the most certainty. However, in the more realistic situation where all models are incorrect or incomplete, the interpretation of model selection outcomes and the role of experimental design needs to be examined more carefully. Using a novel experimental design and model selection framework for stochastic state-space models, we perform high-throughput in-silico analyses on families of gene regulatory cascade models, to show that the selected model can depend on the experiment performed. We observe that experimental design thus makes confidence a criterion for model choice, but that this does not necessarily correlate with a model's predictive power or correctness. Finally, in the special case of linear ordinary differential equation (ODE) models, we explore how wrong a model has to be before it influences the conclusions of a model selection analysis. Different models of the same process represent distinct hypotheses about reality. These can be decided between within the framework of model selection, where the evidence for each is given by their ability to reproduce a set of experimental data. Even if one of the models is correct, the chances of identifying it can be hindered by the quality of the data, both in terms of its signal to measurement error ratio and the intrinsic discriminatory potential of the experiment undertaken. This potential can be predicted in various ways, and maximising it is one aim of experimental design. In this work we present a computationally efficient method of experimental design for model selection. We exploit the efficiency to consider the implications of the realistic case where all models are more or less incorrect, showing that experiments can be chosen that, considered individually, lead to unequivocal support for opposed hypotheses.
Collapse
Affiliation(s)
- Daniel Silk
- Centre for Integrative Systems Biology at Imperial College London, London, United Kingdom
| | - Paul D. W. Kirk
- Centre for Integrative Systems Biology at Imperial College London, London, United Kingdom
| | - Chris P. Barnes
- Centre for Integrative Systems Biology at Imperial College London, London, United Kingdom
| | - Tina Toni
- Centre for Integrative Systems Biology at Imperial College London, London, United Kingdom
| | - Michael P. H. Stumpf
- Centre for Integrative Systems Biology at Imperial College London, London, United Kingdom
- * E-mail:
| |
Collapse
|
3
|
Liepe J, Kirk P, Filippi S, Toni T, Barnes CP, Stumpf MPH. A framework for parameter estimation and model selection from experimental data in systems biology using approximate Bayesian computation. Nat Protoc 2014; 9:439-56. [PMID: 24457334 DOI: 10.1038/nprot.2014.025] [Citation(s) in RCA: 113] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
As modeling becomes a more widespread practice in the life sciences and biomedical sciences, researchers need reliable tools to calibrate models against ever more complex and detailed data. Here we present an approximate Bayesian computation (ABC) framework and software environment, ABC-SysBio, which is a Python package that runs on Linux and Mac OS X systems and that enables parameter estimation and model selection in the Bayesian formalism by using sequential Monte Carlo (SMC) approaches. We outline the underlying rationale, discuss the computational and practical issues and provide detailed guidance as to how the important tasks of parameter inference and model selection can be performed in practice. Unlike other available packages, ABC-SysBio is highly suited for investigating, in particular, the challenging problem of fitting stochastic models to data. In order to demonstrate the use of ABC-SysBio, in this protocol we postulate the existence of an imaginary reaction network composed of seven interrelated biological reactions (involving a specific mRNA, the protein it encodes and a post-translationally modified version of the protein), a network that is defined by two files containing 'observed' data that we provide as supplementary information. In the first part of the PROCEDURE, ABC-SysBio is used to infer the parameters of this system, whereas in the second part we use ABC-SysBio's relevant functionality to discriminate between two different reaction network models, one of them being the 'true' one. Although computationally expensive, the additional insights gained in the Bayesian formalism more than make up for this cost, especially in complex problems.
Collapse
Affiliation(s)
- Juliane Liepe
- Department of Life Sciences, Centre for Integrative Systems Biology and Bioinformatics, Imperial College, London, UK
| | - Paul Kirk
- Department of Life Sciences, Centre for Integrative Systems Biology and Bioinformatics, Imperial College, London, UK
| | - Sarah Filippi
- Department of Life Sciences, Centre for Integrative Systems Biology and Bioinformatics, Imperial College, London, UK
| | - Tina Toni
- Department of Life Sciences, Centre for Integrative Systems Biology and Bioinformatics, Imperial College, London, UK
| | - Chris P Barnes
- Department of Cell and Developmental Biology, University College, London, UK
| | - Michael P H Stumpf
- 1] Department of Life Sciences, Centre for Integrative Systems Biology and Bioinformatics, Imperial College, London, UK. [2] Institute of Chemical Biology, Imperial College, London, UK
| |
Collapse
|
4
|
Toni T, Ozaki YI, Kirk P, Kuroda S, Stumpf MPH. Elucidating the in vivo phosphorylation dynamics of the ERK MAP kinase using quantitative proteomics data and Bayesian model selection. Mol Biosyst 2012; 8:1921-9. [PMID: 22555461 DOI: 10.1039/c2mb05493k] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
Ever since reversible protein phosphorylation was discovered, it has been clear that it plays a key role in the regulation of cellular processes. Proteins often undergo double phosphorylation, which can occur through two possible mechanisms: distributive or processive. Which phosphorylation mechanism is chosen for a particular cellular regulation bears biological significance, and it is therefore in our interest to understand these mechanisms. In this paper we study dynamics of the MEK/ERK phosphorylation. We employ a model selection algorithm based on approximate Bayesian computation to elucidate phosphorylation dynamics from quantitative time course data obtained from PC12 cells in vivo. The algorithm infers the posterior distribution over four proposed models for phosphorylation and dephosphorylation dynamics, and this distribution indicates the amount of support given to each model. We evaluate the robustness of our inferential framework by systematically exploring different ways of parameterizing the models and for different prior specifications. The models with the highest inferred posterior probability are the two models employing distributive dephosphorylation, whereas we are unable to choose decisively between the processive and distributive phosphorylation mechanisms.
Collapse
Affiliation(s)
- Tina Toni
- Centre for Integrative Systems Biology and Bioinformatics, Division of Molecular Biosciences, Department of Life Sciences, Imperial College London, London, UK.
| | | | | | | | | |
Collapse
|
5
|
Silk D, Kirk PDW, Barnes CP, Toni T, Rose A, Moon S, Dallman MJ, Stumpf MPH. Designing attractive models via automated identification of chaotic and oscillatory dynamical regimes. Nat Commun 2011; 2:489. [PMID: 21971504 PMCID: PMC3207206 DOI: 10.1038/ncomms1496] [Citation(s) in RCA: 44] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2011] [Accepted: 09/01/2011] [Indexed: 11/09/2022] Open
Abstract
Chaos and oscillations continue to capture the interest of both the scientific and public domains. Yet despite the importance of these qualitative features, most attempts at constructing mathematical models of such phenomena have taken an indirect, quantitative approach, for example, by fitting models to a finite number of data points. Here we develop a qualitative inference framework that allows us to both reverse-engineer and design systems exhibiting these and other dynamical behaviours by directly specifying the desired characteristics of the underlying dynamical attractor. This change in perspective from quantitative to qualitative dynamics, provides fundamental and new insights into the properties of dynamical systems.
Collapse
Affiliation(s)
- Daniel Silk
- Centre for Bioinformatics, Imperial College London, London SW7 2AZ, UK
| | | | | | | | | | | | | | | |
Collapse
|
6
|
Toni T, Jovanovic G, Huvet M, Buck M, Stumpf MPH. From qualitative data to quantitative models: analysis of the phage shock protein stress response in Escherichia coli. BMC Syst Biol 2011; 5:69. [PMID: 21569396 PMCID: PMC3127791 DOI: 10.1186/1752-0509-5-69] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/19/2010] [Accepted: 05/12/2011] [Indexed: 01/05/2023]
Abstract
Background Bacteria have evolved a rich set of mechanisms for sensing and adapting to adverse conditions in their environment. These are crucial for their survival, which requires them to react to extracellular stresses such as heat shock, ethanol treatment or phage infection. Here we focus on studying the phage shock protein (Psp) stress response in Escherichia coli induced by a phage infection or other damage to the bacterial membrane. This system has not yet been theoretically modelled or analysed in silico. Results We develop a model of the Psp response system, and illustrate how such models can be constructed and analyzed in light of available sparse and qualitative information in order to generate novel biological hypotheses about their dynamical behaviour. We analyze this model using tools from Petri-net theory and study its dynamical range that is consistent with currently available knowledge by conditioning model parameters on the available data in an approximate Bayesian computation (ABC) framework. Within this ABC approach we analyze stochastic and deterministic dynamics. This analysis allows us to identify different types of behaviour and these mechanistic insights can in turn be used to design new, more detailed and time-resolved experiments. Conclusions We have developed the first mechanistic model of the Psp response in E. coli. This model allows us to predict the possible qualitative stochastic and deterministic dynamic behaviours of key molecular players in the stress response. Our inferential approach can be applied to stress response and signalling systems more generally: in the ABC framework we can condition mathematical models on qualitative data in order to delimit e.g. parameter ranges or the qualitative system dynamics in light of available end-point or qualitative information.
Collapse
Affiliation(s)
- Tina Toni
- Division of Molecular Biosciences, Imperial College London, South Kensington, London SW7 2AZ, UK.
| | | | | | | | | |
Collapse
|
7
|
Huvet M, Toni T, Sheng X, Thorne T, Jovanovic G, Engl C, Buck M, Pinney JW, Stumpf MPH. The evolution of the phage shock protein response system: interplay between protein function, genomic organization, and system function. Mol Biol Evol 2010; 28:1141-55. [PMID: 21059793 PMCID: PMC3041696 DOI: 10.1093/molbev/msq301] [Citation(s) in RCA: 52] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/16/2023] Open
Abstract
Sensing the environment and responding appropriately to it are key capabilities for the survival of an organism. All extant organisms must have evolved suitable sensors, signaling systems, and response mechanisms allowing them to survive under the conditions they are likely to encounter. Here, we investigate in detail the evolutionary history of one such system: The phage shock protein (Psp) stress response system is an important part of the stress response machinery in many bacteria, including Escherichia coli K12. Here, we use a systematic analysis of the genes that make up and regulate the Psp system in E. coli in order to elucidate the evolutionary history of the system. We compare gene sharing, sequence evolution, and conservation of protein-coding as well as noncoding DNA sequences and link these to comparative analyses of genome/operon organization across 698 bacterial genomes. Finally, we evaluate experimentally the biological advantage/disadvantage of a simplified version of the Psp system under different oxygen-related environments. Our results suggest that the Psp system evolved around a core response mechanism by gradually co-opting genes into the system to provide more nuanced sensory, signaling, and effector functionalities. We find that recruitment of new genes into the response machinery is closely linked to incorporation of these genes into a psp operon as is seen in E. coli, which contains the bulk of genes involved in the response. The organization of this operon allows for surprising levels of additional transcriptional control and flexibility. The results discussed here suggest that the components of such signaling systems will only be evolutionarily conserved if the overall functionality of the system can be maintained.
Collapse
Affiliation(s)
- M Huvet
- Centre for Bioinformatics, Division of Molecular Biosciences, Imperial College London, London, United Kingdom.
| | | | | | | | | | | | | | | | | |
Collapse
|
8
|
Joly N, Engl C, Jovanovic G, Huvet M, Toni T, Sheng X, Stumpf MPH, Buck M. Managing membrane stress: the phage shock protein (Psp) response, from molecular mechanisms to physiology. FEMS Microbiol Rev 2010; 34:797-827. [PMID: 20636484 DOI: 10.1111/j.1574-6976.2010.00240.x] [Citation(s) in RCA: 168] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023] Open
Abstract
The bacterial phage shock protein (Psp) response functions to help cells manage the impacts of agents impairing cell membrane function. The system has relevance to biotechnology and to medicine. Originally discovered in Escherichia coli, Psp proteins and homologues are found in Gram-positive and Gram-negative bacteria, in archaea and in plants. Study of the E. coli and Yersinia enterocolitica Psp systems provides insights into how membrane-associated sensory Psp proteins might perceive membrane stress, signal to the transcription apparatus and use an ATP-hydrolysing transcription activator to produce effector proteins to overcome the stress. Progress in understanding the mechanism of signal transduction by the membrane-bound Psp proteins, regulation of the psp gene-specific transcription activator and the cell biology of the system is presented and discussed. Many features of the action of the Psp system appear to be dominated by states of self-association of the master effector, PspA, and the transcription activator, PspF, alongside a signalling pathway that displays strong conditionality in its requirement.
Collapse
Affiliation(s)
- Nicolas Joly
- Division of Biology, Imperial College London, South Kensington, London, UK
| | | | | | | | | | | | | | | |
Collapse
|
9
|
Liepe J, Barnes C, Cule E, Erguler K, Kirk P, Toni T, Stumpf MPH. ABC-SysBio--approximate Bayesian computation in Python with GPU support. Bioinformatics 2010; 26:1797-9. [PMID: 20591907 PMCID: PMC2894518 DOI: 10.1093/bioinformatics/btq278] [Citation(s) in RCA: 104] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2010] [Revised: 04/16/2010] [Accepted: 05/24/2010] [Indexed: 11/16/2022] Open
Abstract
MOTIVATION The growing field of systems biology has driven demand for flexible tools to model and simulate biological systems. Two established problems in the modeling of biological processes are model selection and the estimation of associated parameters. A number of statistical approaches, both frequentist and Bayesian, have been proposed to answer these questions. RESULTS Here we present a Python package, ABC-SysBio, that implements parameter inference and model selection for dynamical systems in an approximate Bayesian computation (ABC) framework. ABC-SysBio combines three algorithms: ABC rejection sampler, ABC SMC for parameter inference and ABC SMC for model selection. It is designed to work with models written in Systems Biology Markup Language (SBML). Deterministic and stochastic models can be analyzed in ABC-SysBio. AVAILABILITY http://abc-sysbio.sourceforge.net
Collapse
Affiliation(s)
- Juliane Liepe
- Centre for Bioinformatics, Division of Molecular Biosciences, Imperial College London, London, UK
| | | | | | | | | | | | | |
Collapse
|
10
|
Toni T. The Machinery of Life: David S. Goodsell 2nd edn., 2009 Springer-Verlag, London. Hum Genomics 2010. [PMCID: PMC3500167 DOI: 10.1186/1479-7364-4-5-369] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022] Open
|
11
|
Abstract
MOTIVATION Computer simulations have become an important tool across the biomedical sciences and beyond. For many important problems several different models or hypotheses exist and choosing which one best describes reality or observed data is not straightforward. We therefore require suitable statistical tools that allow us to choose rationally between different mechanistic models of, e.g. signal transduction or gene regulation networks. This is particularly challenging in systems biology where only a small number of molecular species can be assayed at any given time and all measurements are subject to measurement uncertainty. RESULTS Here, we develop such a model selection framework based on approximate Bayesian computation and employing sequential Monte Carlo sampling. We show that our approach can be applied across a wide range of biological scenarios, and we illustrate its use on real data describing influenza dynamics and the JAK-STAT signalling pathway. Bayesian model selection strikes a balance between the complexity of the simulation models and their ability to describe observed data. The present approach enables us to employ the whole formal apparatus to any system that can be (efficiently) simulated, even when exact likelihoods are computationally intractable.
Collapse
Affiliation(s)
- Tina Toni
- Division of Molecular Biosciences, Imperial College London, Wolfson Building, SW72AZ London, UK.
| | | |
Collapse
|
12
|
Abstract
Modelling biological systems would be straightforward if we knew the structure of the model and the parameters governing their dynamics. For the overwhelming majority of biological processes, however, such parameter values are unknown and often impossible to measure directly. This means that we have to estimate or infer these parameters from observed data. Here we argue that it is also important to appreciate the uncertainty inherent in these estimates. We discuss a statistical approach--approximate Bayesian computation (ABC)--which allows us to approximate the posterior distribution over parameters and show how this can add insights into our understanding of the system dynamics. We illustrate the application of this approach and how the resulting posterior distribution can be analyzed in the context of the mitogen-activated protein kinase phosphorylation cascade. Our analysis also highlights the added benefit of using the distribution of parameters rather than point estimates of parameter values when considering the notion of sloppy models in systems biology.
Collapse
Affiliation(s)
- Maria Secrier
- Centre for Bioinformatics, Imperial College London, UK
| | | | | |
Collapse
|
13
|
Toni T, Welch D, Strelkowa N, Ipsen A, Stumpf MPH. Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems. J R Soc Interface 2009; 6:187-202. [PMID: 19205079 DOI: 10.1098/rsif.2008.0172] [Citation(s) in RCA: 655] [Impact Index Per Article: 43.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Approximate Bayesian computation (ABC) methods can be used to evaluate posterior distributions without having to calculate likelihoods. In this paper, we discuss and apply an ABC method based on sequential Monte Carlo (SMC) to estimate parameters of dynamical models. We show that ABC SMC provides information about the inferability of parameters and model sensitivity to changes in parameters, and tends to perform better than other ABC approaches. The algorithm is applied to several well-known biological systems, for which parameters and their credible intervals are inferred. Moreover, we develop ABC SMC as a tool for model selection; given a range of different mathematical descriptions, ABC SMC is able to choose the best model using the standard Bayesian model selection apparatus.
Collapse
Affiliation(s)
- Tina Toni
- Centre for Bioinformatics, Division of Molecular Biosciences, Imperial College London, London SW7 2AZ, UK.
| | | | | | | | | |
Collapse
|
14
|
|